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CHAPTER 1 
INTRODUCTION 


Let La ae be a sequence of independent, identically distrib- 
uted (i, i. d.) random variables having a finite mean w and a finite 
positive variance o*, For any positive constant @, the stopping time 


N(c), defined by 
n 
N(c) = least nm > 1 such that >) x. > covn 
1 
or +~ if no such n exists, 


is finite with probability one by the law of the iterated logarithm, 

An optional stopping time of this form played a central role in 
a controversy over the evaluation of ESP experiments in the late 
1930's, Card-guessing experiments were conducted and were assumed to 
be independent Bernoulli trials with probability 1/5 of a correct 
guess. Experimenters felt that a large "critical ratio"--the deviation 
between the observed number of correct guesses and the expected number 
of correct guesses divided by the standard deviation--would indicate 
the presence of ESP, 

However, it was noted that the performance of a subject tended 
to decline after a long period and sometimes experimenters, rather than 
specifying in advance the length of a run, would terminate it when 
conditions seemed to warrant such a move. That the effect of optional 


stopping had to be considered in the calculation of various probabili- 








ties was pointed out by several critics. In particular, Feller [8] 
demonstrated that the normal approximation for the probability of 
occurrence of a given critical ratio could not be used. Further, 
citing the law of the iterated logarithm, he remarked that with prob- 
ability one any given critical ratio could be attained infinitely often 
and, hence, stopping at critical points could certainly give biased 

1 


results, 


More generally, for any sequence {x} of 1, i. d. random vari- 
n 
ables with mean zero and variance o%, ) X.Jovn may be regarded as a 


"critical ratio.” In this case N(a) defined above is just the number 
of trials that must be conducted to achieve a critical ratio that is 

greater than o or less than -a, A natural question then is just how 

long must one wait to attain a desired critical ratio, 

Several people have studied the expected value of the stopping 
time N(e) for sequences of random variables with zero mean, One of the 
earliest papers was by Blackwell and Freedman [2] in which they 
studied coin-tossing random variables, Later, Chow, Robbins, and 
Teicher ({4] proved that for all i. 1. d. sequences with zero mean, 
EN(o) = + for allo >l, 

To study the case of sequences with nonzero mean, wy will be 
regarded as a translation parameter, In other words, if {x} is a 
fixed sequence with common mean equal to zero, the behavior of the 


stopping time N(a) defined with respect to the sequence {xX ()}, 





lFeller [8, p. 288] gives a hint of his future important work 
on the law of the iterated logarithm when he states that "we are here 
concerned with a trivial special case of deep and interesting problems 
to which a considerable part of the modern theory of probability is 
devoted,” 


x) = x, + u, is analyzed. In particular, for o > 1, I am able to 
obtain bounds for EW(c) in terms of the mean yp and thus obtain informa- 
tion on the way in which EW(c) diverges to infinity as y *+0, This 
problem has been studied by Woodroofe [16]. For sequences with 

alia’ 


E|(X,-n)e < @ for some 6 > 1, he proved the existence of positive 


constants b,, bj, ¥,» Y, with 0 < y, < y, < 1 such that 
-(1 -(1 
b, |u| (1+y71) < EN(o) < by |u| (1+y2) 


for all sufficiently small values of yw. Here, the constants y, and Yo 
depend on the common distribution of the sequence {x}. In this paper, 
the exponents of lu above are replaced by expressions involving a 
single constant which is independent of the distribution of the given 
sequence; however, a finite moment generating function must be assumed. 
Since W(c) < @ almost surely, EWN(c) = } P([N(c) > n] and, so, in 
order to obtain bounds for EW(c) one is led to consider the behavior of 
the probabilities P[N(c) > n] for large nn, Breiman [3] determined the 
asymptotic behavior of these tail probabilities for a slightly differ- 


ent stopping time N*(a@) defined by 
n 
N*(c) = least m > 1 such that 1} x. | > covn 
1 
or +~ if no such n exists, 
For ease of reference, his conclusions are presented here as 


Theorem 1.1. Let ae a be a sequence of i, i, d. random variables 
with common mean zero, finite, positive variance o2, and E\x,\° Stem 
If, for any positive co, N*(c) is the stopping time defined above, then 


either there exists an integer n such that P[W¥*(c) > n] = 0 or there 








exist positive numbers £B(c) and a = a(@) such that P[W*(e) > n] © 


an 86) a5 n+ @,2 


It is important to note that although a depends on the common distribu- 
tion of the sequence, 8(c) is a constant that is the same for all 
sequences satisfying the stated conditions, In fact, -f(c) is the 
largest zero of the confluent hypergeometric function M(A, $, ¢@2/2) 
regarded as a function of the real variable A, The definition of 
M(a, b, x) and some properties of 8 as a function of ¢ that will be 
useful are included in the Appendix, 

The bounds obtained in this paper for EN(c) are dependent upon 
the parameter 8(¢c). Specifically, we show for certain sequences {x} 
that for € > 0 and ec > 1, there exist positive constants A and B, 


independent of uy, such that 


~2[1-B (a) ]+e ~2[1-8 (a) J-e 


Alu| < EN(a) < Bln| 


for all sufficiently small values of »p. The upper bound remains valid 
fore = l, 

Breiman determined the constant @(¢c) first by considering a 
stopping time similar to N*(c) but defined on a normalized Brownian 
motion process, If (W(t), t > 0} is a Brownian motion process with 


drift u, then the stopping time P fe) is defined by 
T (o) = inf {t: [we | > ovtt1}. 


Shepp [13] proved that ET)(c) = t+» 1f ¢ > 1 and ET)(c) < w if a < 1, 


Applying Breiman's results, I am able to show that there exist positive 





2Breiman states his results for a one-sided stopping time but, 
in fact, his proof is for the two-sided time N*(a) defined here. 








constants C and D such that as py > 0, 


ET (ce) » frm se) go> aie 
ET (1) ~ D log sme e= 1, 
ET (ce) + ET, (e) e<l, 


We remark that these relations hold even for uw < 03 in the first case, 
we simply regard u 7 ttaBte)} as (ame 2 

The above results for Brownian motion are not hard to obtain 
and are presented first in Chapter 2. In considering sequences of 
random variables, the general methods used are based on the case for 
which the sequence has a common normal distribution, For this reason 


and, also, since slightly sharper bounds may be obtained (i.e., bounds 


hold for e = 0), this case is considered separately in Chapter 3, 


In order to obtain the desired bounds for EN(¢c) = ) P[N(e) > n], 
0 


it is necessary to obtain bounds on the tail probabilities which hold 
uniformly for sufficiently small yw. In other words, the dependence of 
the constant a in Theorem 1.1 on the distribution of the sequence must 
be eliminated. This is done in Chapter 4, where a correction to the 
proof of Breiman's theorem is given and the appropriate generalization 
is made, 

Chapter 5 concerns sequences of random variables which have a 
continuous distribution function and for which the moment generating 
function exists. The desired bounds for EN(c) are obtained. Finally, 


in Chapter 6, extensions to more general cases are presented, 








CHAPTER 2 
BROWNIAN MOTION 


Let us suppose that {W(t), t > 0} is a Brownian motion process 
defined on the probability space (2, ¢, P). When necessary, we write 
W(t, w) for W(t). We shall assume that this process is normalized; 
i,e., EW(t) = 0, VarW(t) = t, and W(0) = 0, In addition, we shall have 
occasion to use the notation ™ and E” when dealing with probabilities 
and the associated expectations for a Brownian motion process that 
begins at the point xz [i.e., W(0) = xz]. We note that P = P® and that 
P (W(t) € B) = P[W(t) © Bex] for any Borel set BC R!, 

Now, for uw # 0, we wish to consider the process {W(t)+ut, 

t > 0}, a Brownian motion with drift u. For convenience, we write 
W(t) + ut = W Ce) for all ¢ > 0. For any positive number c, we define 


the stopping time 7 = 7 Ce) for the Brownian motion with drift yw by 
T= Tf (¢) = inf {t: [vce] > evt+1}, 


The same stopping time defined for normalized Brownian motion (1.e., 
u = 0) will be denoted by Ty = T,(e). In this chapter we determine the 


asymptotic behavior of ET, (ce) as py > 0. 


Lemma 2.1. The distribution of the stopping time si is absolutely 
continuous, 
Proof. To show that F(t) = PT, < t) 1s absolutely continuous, it 


suffices to show that for some constant K, P(t < Ty < tth) < Kh for all 








t > O and h > 0O. By the symmetry of Brownian motion, it is clear that 
(1) P(t < Ty < tth) = 2P(t < T < tth, W(To) > Oj. 


Now, let us denote the first hitting time of the level a@ by 5a Le, 
S, = inf {s: W(s) = a}, It is well known (e.g., [9, p. 174]) that S, 
has density g where 


1 





g (8) . exp [- 52}, 2 > 0. 


2ne> 


A change of scale shows that 50 has the same distribution as a*S,. 


Thus, in particular, fora = evt+l1, it follows from (1) that 


P(t < Dy < tth) < 2a Ge SOVEL ~ t+h) 


(t+h) [02 (t41) ) 72 





1 
= 2 exp - 3] ds 
tle2(t+1))7> vane° 
2M 
ate 
a2 


where M is a bound for g, lI 


It follows then that the random variable Ly has a density which 
we will denote by fo. We now show that the stopping time T also has a 


density and we obtain a relation between its density and f). 


Lemma 2.2. For any t > 0 and kh > 0 


2 


{t <7, < tth} 


Proof, We make use of the function space representation, For fixed 
t > 0 and hk > 0, we consider the space C[0, tth] of continuous func- 


tions on the interval [0, ¢th]. P, will denote the Wiener measure on 








CLOW tn beet. ec... Es is the unique measure such that 


P [e(+): x(t, ) & Biv soos H(t) G3) 


™ P(W(t,) EC Bis vee W(t) € BI 


for 0 Saar Salen < eee t < t+h and for Borel sets B.C R, 


2 
t= 1,..05", m > 1. Similarly, we denote by P the measure induced on 
C[O, tth] by (W (8), 0 <s < tth}, Shepp [12, p. 348] has shown that 


Pe is absolutely continuous with respect to Py with Radon-Nikodym 


2 
derivative dP dP, = exp - — un(eth)) i.,e., for any 


ACC[0, tth], 


2 ( ) 

(2) PCA) = exp - s a Jee, dP, (x) 
A 

Now, in particular, we let A be the set in C[0, tth] defined by 


{x(+): |x(s)| < evstl, O< 8 < t; 
|x(s) | > evatl for some s € (t, tth)}. 
Then it is clear that P CA) = P(t <T < tth) and 


gul(tth) GP = gux(tth) dP (a) 


{¢ <7, < tth} A 
These equalities together with (2) yield the desired result, lI 


Lemma 2.3. The stopping time 7 has a density function fae Further, if 


pe is the density function of Py then for almost every (a. e.) t > 0 


2 
(3) fC) = exp [- 454) cosh (yevttl) f)(%). 


Proof. As in Lemma 2,1, for t > 0 and h > O we consider P(t < T < tth), 


Writing D = {t < a tth}, we see by the previous lemma that 





2 
(4) P(t < T < tth) = exp - aml gtW(tth) op 
D 


where I. denotes the 


uid : 


We write the integral above as e{ 1, 

indicator function of the set D, 
Next, we define the random variable S= t+h - T, and note 

that on the set D, 0< S<h, Clearly, S is ¥(2,)-measurable where 

3(T,) is the o~algebra consisting of the sets A such that 

An {7 < t}€ o[W(s), s < t] for all t > 0. It follows from the 


strong Markov property that 
t 
alr, e¥(S*70) L507, (w) - r, (apatite?) Wii) uF 
Using the properties of Brownian motion, we obtain 


gh (To) me = E{ exp (ulW(S,w') ae W(T)1)} 
2 
= @XDp fuwry) + a ‘ 


Thus, 


ul (t+h) uW(S+T 9) 
elt, e S g[e12, e le(25)1) 


Z 
= Ez, exp [uW(7 ) t ¥S;) : 


By the symmetry of Brownian motion, this last expectation is equal to 


t+h 
2 = 
| cosh (yevs+l) exp eed fy (8) ds, 


Combining this and (4), we find that 
tth 
(5) P(t < T < tth) = | cosh (povs+1) exp - HE] F506) aa. 
t 
Since this is true for all t > 0 and k > O, it follows immediately that 





10 


the distribution function of T is absolutely continuous and that the 


density i is given by (3) for a. e. t > 0, II 


Before proceeding to the main theorem, it is necessary to make 


one final remark, Breiman [3] studied the stopping time 


T* = T*(o) = inf {t > 1: |W(t)| > evt} 


-B(c) 


and proved that P[T* > t | W(1) = 0} ~ at as t +™, Using the 


definition of T* and the Markov property, we find that 


P[T* > t | W(1)} = P{|W(st1)| < e¥stl, 0 < 8s < t-1 | W(1)] 


= PY) Ft 8) | < evst+1, 0 < 3 <@f-1} 


Thus, P[T* > ¢ | W(1) = 0] = P[|W(s)| < o¥sti, 0 < 8 < t-1} = 
P(T) > t-1) by the definition of T); consequently, P(T, >t) az BC) 
as t + @, 

We show in the Appendix that as a function of oa, 8 is strictly 


decreasing and continuous on [1, +”) and that 86(1) = 1. Hence, for all 


Cc > 1, we see that B(c) <1. Also, we remark that B(c) > 1 fore < 1, 


Theorem 2.1. If (W(t), t > 0} is a Brownian motion process with drift 


yw and if we define for any positive ec the stopping time T(c) by 
T(c) = inf {t: W(t) | > evtt1}, 


then for each c > 1 there exists a positive constant C, independent of 


oO (23) as py + 0, Fore = 1, there exists a 


uw, such that ET(c) ~ Cy 
positive constant D, independent of yp, such that ET(1) ~ D log Wee 


For cc < 1, lim ET(c) = ET (e). 
yO 


Proof, We define the stopping time Ty (e) on the normalized Brownian 








1h: 


motion process {W(t), t > 0} as before, Again, if and f, will denote 
the densities of [T(c) and DP, (eo) respectively. First, we fix ec > 1 and 
we write I, T,, and 8 for T(c), T)(c), and B(c) respectively, 


It follows from Lemma 2,3 that 
2 
ET = t exp - oa cosh (ucvtt+l) f(t) Gis 


We integrate by parts and perform the change of variable s = yt to 





obtain 
(6) BT = 7261-8) P(T, > Cae Le - $67, co) ds 
0 
08 
where v (8) = cosh (c¥aty2) ~ 2 cosh (er + sinh (cvs+y2), 
u 2 oVatyu2 ) 


Hence, it remains to show that the limit as uw > 0 of the integral in 
(6) is a finite positive constant, 


B as ¢ + ~; it follows that 


As noted previously, P(T) > t) Vat. 
the above integrand converges for all s > 0 to a exp - s) a *v, (8) as 
u +O. Further, there is a t, > 0 such that for all t > tie 
t'P(T, > t) < atl, Hence, for all y # 0 and all e > 0, 

(eu?) pcr, Soa z ne _ > ty 

] 


Thus, for all uw #0, 


\(eu") P(r, > ou *)exp|- g]o"Fo, co) S (atte, ®)exp|- TDM EACIE 


We wish to apply the dominated convergence theorem as yw + 0 and, so, it 
suffices to bound Jv, (8) | in a neighborhood of zero, say for |u| < 1. 


For such uw, 


Jv (3) | < cosh (evs+l) + = cosh (ovet1) + avs sinh (c/¥st1), 








12 
Letting the right side above equal w(s), it follows from the fact that 


B < 1 that exp - 4 8 °w(s)de < ©, Thus, by the dominated conver- 
0 


gence theorem, 
(7) lim y21-B) pp =a | exp - s) a *v, (8) ds. 
y+0 
0 
The latter integral is finite; in fact, letting C denote the limit in 
(7), we find from known integral formulas [10, p. 365, #3,.562,1 and 


#3.562.,2] that 


2 
C = a exp [2 (72-28) 17_p49g(-0) eee): 


- 47(4-28) (D (-o) + D (o) ] 


~4428 ~4428 


| 
+ $328) 1D yyy gl ~ Psyng(0)) 


where Dy (2) denotes the parabolic cylinder function. Therefore, from 


~2(1-8) ae, 


(7), ET ~ Cy 
Now, we consider @ = 1, Again, we write T and r. for T(1) and 


Pi) s since 8(1) = 1, (6) becomes 
ET = | P(?, > Bile erie) exp - s] sv, (a) dg 
0 


where v8) is as above with ec = 1. If we define the functions W, and 


W, by w, (8) = = cosh 7s and w, (8) - 18 sinh 7g, then it follows as 


before that 


-2 -2 s} -l 8 
lim P(T, > su -)(su )exp|- ar - 5 cosh’s+ sinhv 9+ Z| de 
uO | : : . ” Vere = 


= Oo exp - 2) a" [-w, (8) +, (8)] dg < ®, 


Thus, 
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P(T, > mmo) oe exp - 3) ve cosh Vet+y2 ds 





ET 0 
lim ————> = lim = ; 
u*0 log u u>0 log wu 


We denote the integrand in the numerator above by w,(s). 
Let € > 0 be given, There exists a bo > 0 such that for 
t>t, |eP(r, > t) - al < «, Also, there exists a 6 > 0 such that for 


ls| < 6, exp - $| - 1| < « and |cosh Wg - 1| < €, For uw sufficiently 


small, ut, < 6 and we write 
oo net, 8 oo 
W(8) de = w,(s) ds + w,(s) ds + W.(s) ds ; 
0 0 yt) 6 
we denote these three integrals by I, I,, and q,. We note that 


i < a cosh uvt +1 and I, < 6 (ate) exp - :| cosh Va+y2 ds; by 


l 


the dominated convergence theorem, this latter bound has a finite limit 


as yp > 0. Hence, 


Ha Tf 
lim ——— = QO, 
ur0 log yu 
We note that 
6 
(a-e)exp|- $} cosh uvt +1 pias <I, < (ate) cosh’§+y2 peas ; 
2 2 
yee, u t 
Thus, 
I, 
(a-e)(l-e) < lim 5 < (ate) (lte). 
uO log 


Letting € > 0, we see that ET(1) ~ a log ‘is as yp > 0, 
Finally, we fix ec < 1 and again write T, Ty» and 8 for T(ce), 
P(e), and B(c), respectively. We seek to show that lim |ET - ET, | = 


u>0 
QO. Using the known densities, we note that 
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2 
|ET - ET | < t|exp - a cosh (yevt+l) - WC, dt . 
0 


Clearly, as wy + 0, the integrand above converges to zero for each ¢, 
Also, since cosh (uovt+1) < exp (lulevt+1), it is not hard to show that 
for uw sufficiently small the integrand is bounded by Ktf,(t) for some 
constant K, independent of yw and t. Since ET (ce) <o fore <1, this 
function is integrable and, therefore, the desired result follows from 


the dominated convergence theorem, II 


io-* eh) cheer 


> < onl 





CHAPTER 3 
NORMALLY DISTRIBUTED RANDOM VARIABLES 


On a probability space (2,%, P), we consider the sequence 
{xa} 2, of 1, i, d. random variables, each having a normal distribution 
with finite mean yw and finite, positive variance o%, As usual, we say 
that x, has a N(u,07) distribution, For any positive constant ¢c, we 


define the stopping time NW = N(e) by 
n 
N = N(c) = least n > 1 such that ») x. | > eaoYn 
1 
or +~ if no such n exists, 


It is our goal to obtain bounds for EN in terms of u, 
We begin with a lemma that is useful here and in later work 


when we study random variables with more general distributions, 


axtyy/x  -B 


Lemma 3.1. For a real parameter yp # 0, let Ff) = @ x ° where 


a = a(y) > O and y = y(y) are such that lim a(y) = 0 and lim y(v)2/a(n) 
w>O yu>O 


= K,, a constant; 8 1s a constant with 8 <1, Then, for each yp # 0, 


Lf < | f,@de + KM) 
. 0 


where the integral is finite and lim K(y) = 0. 
yO 


Proof, We fix p # 0 and write f for foe Clearly, feé c’(0,), f>o, 
lim f(x) = +~, and lim f(x) = 0. Also, an elementary computation 


x+ot x+o 


15 





16 


shows that the roots of the equation f’(x) = 0 are the points 


Thus, if y? < 16a, the function f is decreasing and 


y f(n) < f(x)dz. 
1 0 


On the other hand, if y2 > 1l6a8, then f’(x) = 0 at two points, say x, 


and x, with x, <x Then f is a piecewise monotone function, decreas- 


2° 
ing for x < x, and x > Zz, and increasing for a <a <x, If [zx] 


denotes the greatest integer < x, we see that when (x. ] > (x, ] + 1 that 


oo (x, ] [x ]-1 oo 
Pfiny= 2 fm + fF fm) + fle, + fe, + J fm 
1 1 [x ]+1 [x ]+2 


{A 


[x] (x, ] ee 
| f(c)dx + | f (x)dx + | f@)dz + f(lz,)) + f({x,]+1) 
0 (x, ]+1 [ev }*1 


JA 


| E(ejaxn + 2f(x,)-. 
0 
It is easily seen that the same bound holds even if (x, ] = (x, ] or 


(x,] = [z,] + 1. 


Thus, in any case, y f(n) | f(x)dx + K(w) where 
0 


0 y? < l6aB 
K(w) = 


2f(x,) y2 > 1608 . 


We note that 


2 ae Lyx z 1. aye a 
f(x.) ve e+} = 168] +I eta : 168 
SS oe 2 B 
es: ia calm 
a [tee bt 168| 
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Since y(u)*/a(u) > Kis it follows that f(z,) ~ constant ° Cs as 


uy > 0, and, therefore, lim K(y) = 0. Finally, the value of f(xz)dxe is 
y>0 
0 


known explicitly [10, p. 337] and is finite for a > 0 and 8 < l, ll 


Theorem 3.1. If bea is a sequence of 1, 1. d. random variables with 
a common W(y, 0%) distribution and if N(c) is the stopping time defined 
above, then, for each ce > 1, there exist positive constants A and B, 


independent of yw, such that 


Ay72'1-8(e)] -2[1-8(¢) ] 


< EN(c) < By 


for all y sufficiently small, For ¢@ = 1, there exist positive constants 


A, and B, such that 
-2 =-2 
A, log uw < EN(1) <8, log wu 


for all yp sufficiently small. 
Proof. We first fix @ > 1 and write W and 8 for W(e) and B(e) respec- 
tively, Recall that EW = ) P(N >n). For m> 1, we define the set 

0 


k 
CCR byc= { (x, yeee5t,)! ») x. | < covk, kK = 1,...,n}, Then 
1 


k 
P(N > nm) = Pld x, | < covk, k = Leesan] 
1 





n 
) (x -u)? 
~ eee (202) 7”/2 exp {> on dz, ...dz 
Cc 202 
= exp] - (2002) 7” ose | OXPj- + —} x. dz,» dex 
202 202 o2 1 bs C 


C 


n 
On the set C, |) z | < covn, Thus, if {x '} is a sequence of i, i. d. 
1 
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random variables with a common N(0, o%) distribution and if we define 


the stopping time Ny by 
n 
Ny = least n > 1 such that |} X,'| > covn 
1 
or + if no such n exists, 


then, for allnm>l, 


(1) P(N > n) < exp |- ——+———— P(N, > n) 
202 oO 

and 
nmu2—fule’n 

(2) P(N > n) > exp |= —— - —————| P(W_ > nn). 
202 0 0 


If we define the stopping time vee by 
n 
N)* = least n > 1 such that |) X,"| > eovn 
1 
or tm if no such n exists, 


then we note that Re nas N, a. s.3 hence, in particular, P(N, >n) = 


P(N ,* >n). Now, 
k 
P(N, * > n) > PLDI, < covk, k = Rs 
1 
> Pix," < ca(V7 - ¥j-1), a a ge 
n 
= I Pix," < eo(¥j - /F2) | 0; 
1 


Hence, it follows from Theorem 1.1 that P(N ,* >n) © an”® as n+ 
where a and 8 are positive constants, the latter being independent of 
the distribution of the {x}. Thus, there exists a positive integer 


n, such that for n> n 


0 0% 





1b 


=| 3a <-B 


(3) 7 < PIN* > n) sn”, 
It follows from (1) and (3) that 
nu? |ulovn) _, 
(4) EN <n) +f Big cae st | on —" 


2 
No 20 o 
With a(y) = u2/202% and y(y) = lule/o, we see that the hypotheses of 


Lemma 3.1 hold. Hence, 


30 zur |ylovx 7 
EN<n) +75 exp |= — + ———| x “de + K(p) 
; 202 o 


where K(y) + 0 as » + 0. A change of variable yields the inequality 


2 ice y i 
EN <n, +o K(u) tu *) [3a onl —— sabe 
0 202 ej 
As noted in the previous lemma, the integral above is finite since 8 = 
-2(1-8) 


B(e) <1, Thus, the above bound for EW is O(y ) and, therefore, 


there exists a positive constant B, for example 
ab 
B = 3a exp |- ——-+-——| y ~~ dy, 
0 


Se for all yw sufficiently small, We note that 


such that EW < By 
the constant B depends on the value of the integral and, hence, on ¢, 
Next, using (2) and (3), we see that 
2 
= ny lulovn “i 
>23 exp |- —-——| n®. 
Ny 202 0 

Since the terms of this series are decreasing, we replace the sum by an 


integral and make a change of variables to obtain 


>it . yovy) 
= 2 
2 20% 0 
u No 





= 2 ae A 
lim pel 8) EN > = exp |- —— - —— y"© dy 
uO ; 202 Pe} 


where, once again, this integral is finite, Hence, if, for example, 


y cry =2 
ny te een dy , 


A= = exp |- = 
0 


for all wp sufficiently small. 


202 oO 


then EW > Ay 2 ‘1-8) 


Finally, we consider ¢c = 1. Since 8(1) = 1, we obtain from (4) 





that 
2 
= me  |ulYn 
EN(1) <n, +73] exp |- —+ nl, 
No 202 Oo 


Without loss of generality, we may assume that m, > 2 and can replace 


0 


the sum above by one starting at n = 2 without decreasing the bound, 


Just as in Lemma 3,1, we can show that such a sum is bounded by 





uz |yulv& 
exp |- —— + x7) dx + K(p) 
20% o 
1 
where K(y) +> 0 as » > 0. Again, a change of variables yields 
° y vy 
EN(1) <n ye Rae exp |< <= + —— yo dye 
— 9 Z 2 2 
2 20 0 
u 
For y2 < 1, we see that 
oo * a 1 
EN(1) < n, + = K(u) + + exp j- —— + —} y7!dy + A y~ldy!., 
1 202 fo} ne 


This bound is O(log ie and, so, there is a positive constant B, such 
that EN(1) < B, log rae for all uw sufficiently small, 


For the lower bound when oc = 1, (5) becomes 


g g 
2 202 fe) 
ung 
For uw such that urn, <1, 





ok 


; ae i y vy 
EN(1) 25 ope y~ldy +5 exp j- = -— paket, ‘ 
202s > 202 o 
u“ny a4 l 
Thus, there exists a positive constant A, (e.8e, hy ee exp - cin -|) 
20 Go 


such that EN(1) > A, log uw” for all u sufficiently small. II 


Now, of course, we would like to obtain the same type of bound 
for EN when the sequence {x} has a more general distribution, First, 
we present an important preliminary result in the next chapter, Then, 
in Chapter 5, we are able to use essentially the techniques of the 
previous theorem to obtain the desired result for a wider class of 


sequences, 





CHAPTER 4 


UNIFORM BOUNDS FOR TAIL PROBABILITIES 


We now wish to direct our attention to more general sequences 
of i. i. d. random variables having a common nonzero mean u. We again 
wish to study the stopping time WN determined by the first exit of the 
random sum from a square root boundary. To obtain information on the 
behavior of EW as » + 0, we study the probabilities P(N > n). 

Breiman [3] obtained the asymptotic behavior of these probabil- 
ities for the zero mean case. In studying the nonzero mean case, we 
will be led to consider collections of sequences of i. i. d. random 
variables indexed by the parameter yw. For each yp, the corresponding 
sequence will have a zero mean. We will need to extend Breiman's 
result and to obtain bounds for the tail probabilities which hold 
uniformly for sufficiently small values of u. These bounds will then 
enable us to study EN for various sequences of random variables with 
nonzero mean, 

To make the required extension, all that is really necessary is 
to closely examine Breiman's proof for a single sequence and make some 
appropriate alterations. For ease of reference, the first section is 
devoted to an examination of some of the details of this proof. In 
fact, a different approach is taken at one point in order to avoid an 
inaccuracy in the original proof. In Section 2, we first make the 


extension so that the results hold for a general class of distribution 


Lie 
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functions. Then, at the end of this section, we will obtain the result 


on which the subsequent work depends. 


1, The Proof for a Single Sequence 


of i. i. d,. random 


We begin by considering a sequence (xe}e s 


variables defined on the probability space (2, #, P) with EX, = 0, 
EX,* = g2 > 0, and E\x,|° <@, For any c > 0, we define the stopping 


time 
nm 
N* = N*(c) = least m > 1 such that |) x | > eon 
1 
or +” if no such n exists. 


Breiman obtained the asymptotic behavior of P(W* > n) as n + © and his 
results have been stated in Theorem 1.1. Here, we review the methods 
used, 

First, we introduce some notation. Let ty) be a fixed, arbi- 
trary positive number and for t > 0, let m = eA and n = te2 Steg) 


where [x] denotes the greatest integer less than or equal to x. Then, 


k 


denoting ) x; by S,, we define Ply, t) and Q(y, n, t, Fe by 
1 


k 


P(y, t) = PIS, < yovm; N*(c) > m] 
OGynien ©. ty) = 


P(S < yorn: |S, < covk, K = Myeeeyn | on = novm). 


Also, if {Y(t), t > 0} is the Uhlenbeck process [i.e., Y(t) = Wiesel 


where W(t) is normalized Brownian motion], we define Q(y, n) by 
Q(y, n) = Prob{¥(t,) < v3; |l¥(t)| <e, O< t< t | YO) =n). 


Breiman proves in his Proposition 1 that there is a constant D such 
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that 


(1) sup |Q(y, n, t, t)) - Q(y, n)| cepenaae 


Ys," 


We also denote the Laplace transform of P(y, t) by P(y, 2) selces. 
Ply, 8) = ee P(y, t) dt where 8 is a complex number. 
0 
More generally, for bounded functions f defined on [-c, ec], we 
C 
write P(f, t) = f(y)P(dy, t). Writing I. for the indicator 
-c 
function of [-e, ec], we note that Pl. t) = P(N* > eae We let 


P(f, 8) denote the Laplace transform of P(f, t). These Laplace trans- 
forms are analytic in some half plane of €@; in particular, we assume 


that {a: Re a > Dah is the maximal half plane of analyticity of 


~ 


P(r» *). It follows from Fubini's theorem that for bounded f, 
c 
P(f, 8) = f(y) Pldy, 8) for all 8 with Re 8 > 8 


-C 


0° We wish to show 


that Be, *) has a pole at 8 2 8,, but that for some 6 > 0, this is 
the only singularity in {s: Re a > 8) - 5}. In doing this, Breiman 
made an error which we are able to avoid; however, the argument needed 
is a lengthy one, 

In an effort to obtain a series expression for Ea, 3), 


Breiman is led to consider solutions of the differential equation 
(2) yi (ew) - xyp'(e) = AP) 


with boundary conditions W(-c) = ¥(c) = 0. The transformation $¢(x) = 
2 
exp - "| (x) changes (2) into the self-adjoint Sturm-Liouville 


system 
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o" (x) + (4 - dx*) g(x) = AG(x) 
(3) 
¢(-c) = ¢(c) = 0. 
Much is known about the eigenvalues and eigenfunctions of such 
a system, (The facts that we state here may be found, for instance, in 


Coddington and Levinson [5, Chapter 7].) The eigenvalues {1} of the 


system (3) can be ordered so that do > , > r, > ... 3 also, lim dy = 
ko 


-~, In this particular case, the functions ene M(A/2, 1/2, x2/2) 
are known to be even solutions of (3) ([1, p. 686]) where M(a, b, 2) is 
the confluent hypergeometric function; it follows from the boundary 
conditions that do = -2B(c@) where 8 is the function discussed in the 
Appendix and used in the previous chapters. The eigenfunctions {o,} 


can be chosen so that they form an orthonormal set; i.e., 
Cc 
¢, (=) ¢ (x) de = orgs Of course, the eigenvalues of (2) are the 
-0 
same as those of (3) and if for any f, g in L*(-c, @), we define the 
c 
inner product (f, g) = exp - = f(x) g(x) dx, then the orthogon- 
=¢ 


ality relation becomes (Y,> ve = Bat 
A further property of the eigenfunctions is that they form a 


complete orthonormal set for L*(-c, @); i.e., for any fe L*(-c, ¢), 


the series ) (fv )¥- converges to f in the Z* norm. More fundamental- 
1 


ly, if f € C*[-e, ce] and satisfies the boundary conditions [i.e., 
f(-c) = f(e) = 0), then the above series converges uniformly to f on 
[-c, ce]. 


We will also need to know how these eigenvalues and eigen- 
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functions behave, Tricomi [14, pp. 169-177] gives asymptotic expres- 
sions for eigenvalues and eigenfunctions of general Sturm-Liouville 


systems. Applying his results to the case considered here, we find 


that 
33 
Dili = 5 55 (ntl) a le rie Z| + O(n-2), 


¢,, (x) = H sint (nt) x EE $2) = = T(x) cost (#1) | 22 $2) + O(n72) 


Z 
where T(z) = so(ate)§ = (ate)? + {2 - 3] (ere). He also obtains an 


expression for the derivative of the eigenfunctions which becomes 
¢,' &) = al (+1) cost (+1) x] 242] + T(x) sin (+1) n| 222) } + O(n7!), 
Cc 


Expressions for the eigenfunctions of (2) are obtained by noting that 


2 
¥,, (2) = exp Ez], (2). We note that, in particular, Ja = 0(m*) and, 
hence, ) [Amal < @, Also, for large n, V,, (&) = Q(1) and ¥,, &) = 0(n) 


uniformly for x € [-c, ec]. 
Now, for all f € C* with f(-c) = f(e) = 0, we can write f(x) = 


) v=) where the series converges uniformly. Using this repre- 


sentation, Breiman shows that for such f, 


Cc 


l 


, P(f, 8) =) ————-(f,¥, .(y)I(dy, 
(4) (f, 2) 5 ae — ¥)| ¥.C)I(dy, 8) 


-C 


for Re s > By» 8 ¥ XG. j > 0, where 
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0 
I(y, 3) = 2% pete P(y, t) dt 
0 
(5) es 
+ [Q(y, n, ty t))-OCy, n)le °’P(dn, t)dt . 
0 “=< 


It follows from (1) that I(y, 8) is analytic in {s: Re 8 > 8, - 1/16}. 


0 
Integrating by parts and using the Schwarz inequality and (2), we 


obtain 
Cc . 
| ¥(y)I (dy, s) | < ky sup lI, 3) | exp|- ~ [v.." Cy) ]2dy $ 
Y 


<4, sup [I(y, a) [a,? 
" 


where Ky is a constant depending only on ec. Further, if 6 = x + ty, 


then, using (1), we see that 
C 
6) |x| to D z 
( | ¥(Idy, s)| < X, [te + DP(I,, = + 1/16)}|a.,| : 
-c 
At this point, Breiman claims that the sum of |(1, v1 lal? is 


absolutely convergent and, therefore, f can be replaced by 1 in (4) to 
a t 
obtain a series expansion for Pl, 8). However, if y| (1, Pa 


< @, then certainly > ag ¥.)| < , and, so, S(x) = yew #9, ) is 
0 


uniformly convergent and continuous on [-c, ec] and S(-c) = S(e) = 0. 


Since 1 E L*(-e, C), }(1, ROA converges to 1 in L* norm and, hence, 
0 


S(x) = la. e.3 but this is a contradiction since both S and 1 are 
continuous but do not agree at -e and ec. 

To avoid this difficulty, we choose a sequence of "nice" 
functions which converge to 1 on (-e, @) and use (4) to obtain the 


desired expression for EGE 8). Specifically, for each m > 1, we can 





28 


choose functions i € C*[-e, ec], fe) - fb) = 0, de = lon 

[-c ae c- ah. and |f ‘| < 2n, Then, f(x) + 1 for all x E(-c, ¢). 
n n nmin n 

We note that we can write (4) with We in place of f. We denote the 

half plane of analyticity of CL 8) by FE; i.e., BE = {8: Re 8 > Sy}. 


Also, we define FE’ = {s; Re 3 > 8, - 1/16}; we recall that I(y, 3) is 


0 
analytic in E’, We now prove several lemmas which we use to obtain the 
relationship between 8 and the eigenvalues, 

Lemma 4.1. For all 3s € E, lim Pf 8) = PCL, 8). 


1 Sa eco 


Proof. By the bounded convergence theorem, lim P(f > t) = Pls t) 
nro 


since P({-c, c}, t) = 0 for all t€ (0, =). Also, |P(f,, t)| < 

PCI t) and, so, by the dominated convergence theorem, lim Pf» s) = 
Noo 

P(I,, 8) for all s€E, II 


Next, we note that it follows easily from the definition of the 


inner product and the bounded convergence theorem that lim (fn ei) = 
Noo 


(1, ¥.) for each Jj > 0. Hence, it is clear that each term on the right 
side of (4) with f replaced by i converges to the corresponding term 
with f replaced by 1 for alls EE’, s ¢ More j > 0}. However, we must 
also show that the tails of the series converge asn~+™, Let Ay = 
r,, t = k+l, k+2, ...} for each kK > 0. Then, for each k > O and each 


nm > 1, we define the function Ip » On BINA, by 
b ] 


Cc 
Be eye es 
Ip 68) > a ato to Snr YP] ¥ DIG 8). 
e ~-é -C 


Lemma 4.2, The function ie is analytic on BINA 
9 


Proof. Each term of the series is analytic in BINA, and, so, it 
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suffices to prove that the series converges uniformly on each compact 
subset of BINA, Since the only limit of the eigenvalues is at -@, 


there are at most a finite number of points of A, in E', Let K bea 


8tg Ast 
aad oly < 42 


compact subset of BINA, Then, for s EK, le 
constant independent of s and j. Since ACG *) is analytic on £, it 
is bounded on the compact set K* ss {ge + 1/16: s© K} CE. Thus, using 


(6), we find that for s EK, 
Cc 
: 
IF» ¥s) | ¥eGr) Tidy, 8)| s MIF,» 991151 


-C 


where M, is a constant independent of s and J, 
Thus, to prove that In is analytic it remains to show that 
> 


Gs e111 <, By the Schwarz inequality, this sum is less than 


or equal to bikes 0 oat?) *[Diagiayt If L is the operator defined 
by L = p" - xp', then, since pe € C* and satisfies the boundary condi- 
tions of (2), it follows that (fa ¥)¥ = (fi Be) = (Lf vg 
These are the Fourier coefficients of the continuous (hence, square 
integrable) function Lf, and so LI Gf» ¥.)|? < ©, We remarked previ- 


ously that )|a.[7? < , This yields the desired conclusion. I 
Cc 

Lemma 4.3. lime [1 - FOO 1G, gs) = 0 uniformly on compact 

-¢ 


subsets of EF’, 
Proof. Let K be a compact subset of EF’, I(y, 8) is given in (5) as 


the sum of two terms and we consider each one separately. For the 
Cc to : 

first, we must examine [l - f,0)] e® P(dy, t)dt. Using the 
-Cc 0 


definition of fy we see that for s = x + ty and A = (-c, -c +2) YU 


(c -<, C), 





30 


c to bo 
|| 1 -F,00) e**p(dy, t)dt| < "P(A, t)dt 
-C 0 0 
alte 4. My) (5 
Ei n 
jx |t Sr 
On kK, e 0 is bounded and P 7 cA, +0 asn-+o for each gj. Thus, 
d 
a t 


0 
lim [1 - FO) AN K t)dt = 0 uniformly on K, 


(aoe -C 0 


Now, considering the second term in the definition of I(y, 8), 


C 
we write J(y, 3) = [Q(y, n, &, t,)-2y5 n) Je? "P(dn, t)dt. Then 
0 “-e 
C 
we must show that e 0 | [1 - f (y)]J(dy, 8) = 
-¢ 
-38to _ 
e [1 - fy) la(dy, s) > 0 uniformly on K, Since J(-c, 8) = 0 
A 
n 


and If, | < 2m, an integration by parts yields 
1 
a -C+ a 
-S3 bo -xto 
(7) le [1 - f(y) lo(dy, s)| < 2ne 


-¢@ -C 


l7(y, 8) |dy 


for s =x +ty. We note that as y + -c, both Q(y, n, t, t)) and 
Q(y, n) converge to zero. Also, for all s € K, there is an x, such 


that Re s > xX) > 8) - 1/16, and, therefore, 
© °C 
-<ot 
I7(y, a] < lay, n, t, t))-Q(y, n)le~o"P(dn, t)dt. 
0 “=e 


The integral on the right goes to zero as y + -¢ by the dominated con- 


vergence theorem and, so, lim J(y, s) = 0 uniformly for s € K. Since 


y+-¢c 
a 0 is bounded on X, it follows from (7) that 
lk 
Bop ate 
-st 
lime ° [1 - f (vy) ld(dy, 8) = 0 


rico 
=¢ 
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uniformly on K, Letting Ji, 8) = J(y, 8) -d(ec, 8), a similar 


argument shows that 


Cc 
ea | {1 = F061 1d, (ay, s) = 0 
c= 


uniformly on K. Combining these results, we obtain 


Cc 
lim @79%0 | [1 - f(y) ]I(dy, 8) = 0 
7-poo a3 


uniformly for s EK, Ht 


Lemma 4.4, For each k > 0, lim 9, 62) exists uniformly on compact 
roo 7 


subsets of EINAL. 


st pO Py ad = i .t st pes ee 
ee J os : = @€ Scone +ed Ve = J 0) ale Then 


ian C 
gs ee (f., ¥.)] we(y)I(d 
ee ‘ : Vv. 6) 
iT 20 eee J 
e —-@€ -C 


Proof. We write (e 
Sy Ae) = G(s) +e 


st 


C 
where G (es) =e 9 ) (f_, v-)| w.Cy) (dy, 8) which, in turn, equals 
‘ kt1 " 9} 9 
-C 


Cc 


- (fi | ¥, MIG, s) dy. As before, we can show that 
+] 
-¢ 


27 8*0 


C 
, | lf, ow) [le-'(Iy, 8)| dy <@, thus permitting an interchange 
k+1 sn i 
-c 


of the sum and integral. Hence, 
ed oo 
-8to : 
-G_(s) e | hee ¥.)¥. cote, s) dy. 
-c 


° = ° ' om} A 
Since ¥."(y) = 0(9), (fs ¥.)¥. (y)| <M | Of,, ¥.) | and, so, again 


) (f_, ¥.)¥.'(y) converges uniformly. Thus, this series is the deriv- 
Ei) lilies 


eo k 
ative of the function oh Sut ¥)¥<(¥) s £01) = Lys wy) ELS 2 
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Therefore, 
c (o 


k 
f(y) dy, 8) - LF» ¥)| ¥CIT(dy, 2]. 


-@ =C 


= -3to 
G(s) e 


Now, let K be a fixed compact subset of E'\A It follows from 


k° 
Lemma 4.3 and the remarks concerning the convergence of (fi ey that 


lim G (8) exists uniformly for 8s © K. To complete the proof of the 


no 


lemma, it remains to show that lim h, (8) exists uniformly for 3s © K 
ype 
where 


A sb 


- -8to : e 
h,(8) =e 2, a os, ty Sn ¥)| viCrI (dy, 8). 
e -@ -C 


We will denote the above series with See replaced by 1 by hy (@)- 
We first show that these series converge uniformly for all 


s € K and alln> 0. We note that form >k ands EX, 


3 a0 Cc 
-8to e 
——_—_—_—— : (y)I 
le ms at, xe, V2) 92%) (dy, 8)| 
e -e -C ~ 
0 
<Klfl, pes ja. 
o X.t t 
<k, Je? *fa,| 
m+1 














where f = We orl, denotes the L? nom, and kK, and kK, are con- 


2 


Zune 
stants independent of s © K and nm. Recalling that JA. ~ fs J » we 


rA.t 
see that Je d fa |? <@, Hence, given € > 0, there exists an integer 


my = my (€) such that for m > m 


0° 
_ A.C, Cc 
-8to ed 
le iar ee eI (dy, a)| <e 
ma e ne 7° . -c 


for all s€© X and f = Je or l. It then follows immediately that 


lim A (8) = hy(s) uniformly on X. II 
reco 
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We note that because of the uniform convergence, the limit 


function, say Fy» of the In n is analytic in the domain E'\A Also, 
9 


k° 
Jy is seen to be the function 


Cc 


k 
-st 
g,(8) =e" 1T(e, 8) - J(1, ¥)|  ¥(I(dy, 2) 
0 
-Cc 
(8) os eri c 
e 
ct ——————————=—(], y. (y)I(d ° 
2 St att ¥) | ¥sOT(dy, 8) 
@ -é -C 
We now seek to locate 84 in relation to the eigenvalues. 
c 
Proposition 4.1. If for any k > 0, ¥ Cy) (dy, - =0,0<7 < 
-c 
c 
then By x Ay Equality holds if vy. CI (dy, 1) #7 0. 
-c 


Proof. Starting with (4) with f replaced by fe and taking limits as 


n+, we obtain by applying the previous lemmas that for alls €B£, 


gs 7 as 
r kel, “ 
P(I,, 8) = ) SE 0 re vr I(dy, 8) 
0 0 g O 
e@ -e -c 
(9) C 
1 
+ ty ey Vy) ¥, ()I(dy, Ss) + 9, (8) 
@ -e -c 


where Fy, is analytic in B'N\K,. By hypothesis, the finite sum on the 
right is amalytic in E£' and, so, in fact, (9) holds for all s€ ENA |: 
Now, if dy < 80s then the second term on the right of (9) is analytic 
in {s: Re 8s > Bie 5} for some 6 > 0. Thus, the right side of (9) is 
an analytic function on {s: Re s > ys §} and, as such, defines an 
analytic continuation for PI, 8). However, the latter is the Laplace 


transform of the nonnegative function PUI» 6) therefore, it cannot be 


analytically continued across its axis of convergence (see [15, p. 
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58]). This contradiction implies that e, <r’ 


0 k° 
Next, (4) with f replaced by v, yields 
Cc Cc 


¥, (Pay, s) = Ta ¥.(y)I(dy, 8) 


-¢ e We -¢ 
for alls €E, s ¥ Ae Now, suppose ¥, (vy) I (dy , d,) # 0 and assume 
-C 


8, < Aye Then the left side above is analytic in £, the right side has 
a pole at AEE, and the two functions are equal in every small neigh- 


borhood of die Thus, we again have a contradiction and, so, 8») = di if 
Cc 

¥, (y)I(dy, A.) #0. I 
-C 


Now, there are two possibilities; i.e., either 


¥, (yi (dy, dp) = 0 for all k > 0 or there exists an integer k > 0 
-¢ Cc 
such that ¥,. (VI (dy, di) *¥ 0. These possibilities are exactly what 
~c 

determines how P(N* > n) behaves for large n. We obtain immediately 
c 

Corollary 4.1. If ¥,. (y)I (dy, d,) = 0 for all k > 0, then there 
-C 


exists an m > Q such that P(NW* > n) = 0. 


Proof. By the previous proposition, 8 xr, for all k and, therefore, 


0 


olin It is in this case that Breiman shows that P(N* > n) = 0 for 


some integer n, I| 


On the other hand, suppose now that k is the smallest non- 
c 
negative integer such that ¥,. (yi (dy, di) #0. Then, applying 
-c 
Proposition 4.1 to (4), we find that for all fe C2 with f(-e) = fle) = 


0 and for all s € {8: Re 8s > ,} 
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S 1 
P(f, 8) = “et, 4,6, ¥) ¥, Cy) I (dy, 8) + h p(s) 


é —€ -C 


where hp is analytic in {s: Re 8 > d, - 6} for some 6 > 0. This 


expression shows that Pcf, 8) a /(s-A,) as 8 > hee) where a = 
“1 -A,t, : 7 
t) @ (f; +) ¥,. Cy) I (dy, di) P(f, 8) is the Laplace transform 
-c 
of P(f, t) and, so, by a Tauberian theorem due to Karamata ({15, p. 
192]), it follows that | e P(f, u) duvatast+*, For f> 0, 
0 


this integral is nonnegative for each t and, so, a > 0. Consequently, 
Oe ¥,) must be of constant sign for all f © C*, f(-c) = f(e) = 0, 
f > 0. Therefore, vy must be of constant sign and the only such eigen- 


function is Vo > 0 on (-c, ec). Thus, we have proved 


Corollary 4.2. If 8) = A, for some k > 0, then, in fact, 8, = Aj. 


Now it is possible to rewrite (9) as 


Cc 


1 
“8to_,hoto ¥1 Wy lvI(dy, 8) + Als). 


=-C 


Moy P(E. a) = 


e* 


This equality holds for all s € {s8: Re 8 > Ay} and we note that A is 


analytic in {s: Re 8 > A, - 6} for some 6 > 0. It follows from (8) 


that 
c 
n(s) = e °"91r(e, 8) - (1, ¥) | ¥9(v)I(dy, 8) 
-@ 
(11) - Asbo c 
+ J —2——_(1, v.) | ¥. Cy) I (dy, 8)|. 
} sty eG J my) 
e =e =-C 


We now wish to make use of the following modification of a 


Tauberian theorem due to Ikehara. 
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Proposition 4.2. If @(t) is a nonnegative, nonincreasing function for 


t E[0, ~), (0) < —, if the integral @(8) = Pe o(t) dt 
0 


(es = x + ty) converges for Re 8 > x. with xz) <0, and if for some 


0 


constant a and some function g(y), 


lim [eco = a = g(y) 
eRe iG 


xX 


uniformly on every finite interval | y | Z Yo» then lim e 0% o(t) =a. 
tam 


Ikehara's Theorem asserts the same conclusion for a function ¢ 


that is nonnegative and nondecreasing and for x, = 1. A proof of this 


0 
theorem is given by Widder [15, pp. 233-236] and by Doetsch [6, pp. 
216-222]. Only slight modifications of these proofs are necessary to 
obtain a proof for Proposition 4.2. Hence, the proof will not be given 
here. 

We may note, in particular, that if ¢(s) is amalytic in 
{g; Re s > oe 5} for some 6 > 0 except for a first order pole at 


8 = =e then the constant a is just the residue at that pole; i.e., a = 


lim (8-%))%(s). We see from (10) that Pd ¢) is analytic in 
87x 
0 


{e: Re s > Ay - §} for some 6 > 0 except possibly for poles at the 
points 8 = Ay 1 annt/t, However, PG °) is independent of the 
parameter te and, so, the only singularity of PCI, °) in 


{s: Re s > Ay - 6} is the first order pole at s = Age Applying 
Proposition 4.2, we find that lim pee 


PCL t) = a where a = 
tooo 


ty te*970(1, oy | vo(y)T(dy, Ag) > 0. As noted above, Ay = -28(e) 
-< 
and PCL,» t) = P(N* > Cake It follows immediately that P(W* > n) % 


0 
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an 8 62) 


asn-+o, This, together with Corollary 4.1, is the content of 


Breiman's result which we have stated previously as Theorem 1.1. 


2. The Untform Result 
Let C be a class of probability distribution functions such 


that each F € C satisfies the following properties: 


(i) x dF(x) = 0 


(ii) m< oo = x? dF(x) 


(iii) |jx|3 dF(x) <M <> 


—&d 


(iv) F is continuous except possibly at zero. 


We remark that m and M are positive constants which are independent of 
F. 

With each F€ C, we may associate a sequence {x} 0-1 of 1. 1. Gd. 
random variables defined on some probability space (2 ae P,) such 
that Xx, = x, (F) has distribution function F. For this sequence and for 


any c > Q, the stopping time VV, = W fe) is defined by 


P 


n 
Ny = W AC) = least m > 1 such that p x.| > co vn 


or +e if no such nm exists. 
4a N_* 
If we define Ne Np (ec) by 
n 
Nv," = Np*(e) = least nm > 1 such that I} x, | > co p/n 
or te if no such nm exists, 


then, since the only possible atom of the distribution function P 
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occurs at zero, it follows that Np « Ny a. S. [Pp] - Thus, in particu- 
lar, PW, >n) = P(N," > mn). Hence, Theorem 1.1 may be applied to 
the sequence {x} to obtain the fact that either (a) for some n, 


~B (ce) as n> where B(e) is the 


PAW, >n) = 0, or (b) PW, >n) %~ an 
same for all FEC, 
Henceforth, we will be interested only in the case e > 1, for 


such c, Chow, Robbins, and Teicher [4] proved a theorem which implies 


that EV, = +, Thus, (a) is excluded for ec > 1. We now seek to show 


F 
that (b) holds uniformly for all Pee; i.,e., that lim np wy > n) 
- ne 
= Gp uniformly for F©& i 


Just as above, we fix an arbitrary t, > O and for t > 0, we 


2 (t+tq) 


define m = fet] and n = [e ]. For each FEC, we define 


Po(y, t), Qp(y, n, t, to), PA» t), and Peas 8) as above; e.g., 


m 
eas ¢) PIS (F) < Yo ,¥m; N,> m) where 5 (F) = } X.(F). First, we 


prove that (1) holds wiformly for FEC, 


Lemma 4.5. There exists a constant D such that for all F € Cc, 


sup lan(y> n, t, t) - QQ, n)| < peat t 2? 

Yon 
Proof. Prohorov [11, p. 202] obtains an estimate of the rate at which 
the measure P on C[0, 1] comverges to the Wiener measure, where P is 
the measure generated by the functions in C[0, 1] which are formed by 
linearly interpolating between the values of W independent random 
variables. For the case considered by Breiman in his Proposition l, 
the upper bound Py for the distance between these two measures is of 


-1/8 


the form Oy = kN (log N)? where NW = n - m and k is a constant, 


independent of NW but dependent on F. A careful analysis of Prohorov's 
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work shows that k depends on o_* and E\Xx, (F)| 3. However, since for all 


FP 
Fee, one > m and E|X, (F) |? < M, we can replace Py by Py = 

Rive sacalae N +k")? where k’ and k" are constants independent of W and 
FEC. Then, Breiman's proof shows that there is a constant D, now 
independent of FEC , such that sup Cee n, t, ty) - Q(y, n) | < 


: Yon 
pe t/16 coy ald FEL, II 


Next, we recall that in the first section we showed that if 


PAN, >n) > 0 for all n, then P I 


o? 8) is analytic in {8: Re 8 > Lots 


i.e., the half plane of analyticity is the same for all FE. Also, 
we obtained the asymptotic behavior of PW, > m) using Proposition 
4.2. Now we are interested in not a single function @, but rather a 
certain family of functions indexed by the distribution functions 
PEC. In general, we consider a family of functions, say {>> w EW} 
where Wis an arbitrary index set. In order to show that the conclu- 
sion of Proposition 4.2 holds uniformly for all $5» wE W, we require 
that the corresponding a, and 9. satisfy certain restrictions. More 


precisely, we prove 


Proposition 4.3. Let {¢ w EW} be a family of nonnegative, nonin- 


creasing functions on (0, ~) for which sup {$ (0): w EW} < ©, Suppose 


that for every wE W, the integral # (3) = oa ¢, (2) at 
0 


(s = x + ty) converges for x > 2) where x) < 0 is independent of wu. 
Suppose also that there are constants a, and functions 9, such that for 


each w € W 


mer 2 
lim j¢ (8) - =< | =g (y) 
a wW SZ wW 
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uniformly on every finite interval |y| ZY. Tf {a w €W} are 
uniformly bounded and if {g,, w€’w} are uniformly bounded and equi- 
continuous on every finite interval, then lim Poe @ (6) =O, 
uniformly for w& W. 


Proof. Let us define the functions 


—Xot 


e ¢,(t) t>0 
a(t) = 

0 tax 0 

a, t > 0 
A(t) = 

0 t<0O, 

and for any A > 0, the functions 
1 fsin dx)? 
k, (x) = 2A F{ se) 
Ne al de 

Loe Pa |x| = 2 
Ky (=) = 

0 |x| > 2a . 


It is a well-known result of harmonic analysis that K) (x) is the 
Fourier transform of ky (=). 
Following Widder's proof of Ikehara's Theorem as adapted to 


Proposition 4.2, we arrive at the identity 
2d 


—- = tay 
(12) al k, (x-t) la (t)-A(t) Jdt 7 K, (ye g,, yey 
= 2h 
for each w € Wand each A > 0. The hypotheses on the functions 9, 


imply, by Arzela's Theorem, that {y,, wEW} is a compact set. Using 
this fact together with the Riemann-Lebesgue Theorem, we see that the 
limit as x + @ of the right side of (12) is zero uniformly for wEW, 


Further, since the a, are uniformly bounded, 


aw 
lin — kK. (x-t) dt =a 
Deo ¥2T 0 r w 
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uniformly for w€'W. Hence, for each A > 0, 


1 
lin —— k. (x-t) a (t) dt=a 
V2" a A w w 
2 
uniformly for w & W, Writing 6(2x) = Bets » we note that kK, (x) = 
vin\ = A 


245 (2Az) and, so, a change of variables yields 
(13) lim 


uniformly for w € W. 
Now, following Doetsch's proof of Ikehara's theorem, we let 


e > 0 be given, Then, there is an x, = x) (e, A) such that for x > z,, 


l 


1 1 cE 
= 6 (t) a,| -2-_% dt <a, +e/2. 


ami® 


Since the integrand is nonnegative, the region of integration can be 
reduced to [-2YA, 2YA]. We note that a (ye 4 = ¢ (y) is nonincreas- 


1 t 
ing and, therefore, on the interval [-2/r, 2v\], a2 - a5 - oa > 


1 t 2 
a (x) exp |-Xp - Pas a > a (x) exp lz, A since x) < 0. Thus, for 
z> 2), 
avr -} 
2}/ 1 
a(x) < (a. + €/2) exp |-x, —||— §(t) dt 
aC ) (a, , /2) Pp 0 = Jaq (t) 
-2vd 
Since 6(t) dt = 42x, for A sufficiently large, the right side is 


less than a, +e. Hence, fixing such a A, it follows that for all x > 
x (e, A), a (x) <a, + €, 
Also, (13) implies that there exists an x, = xo (le, 4) such that 


for © > Xo, 


1 1 t 
Tix 5(t) ae + - # dt >a, - e/2. 


=p 


For t <x), we note that a(t) < gan ¢(t) <e "0%! » (0) and for 
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t>z,, a(t) <a +e. By hypothesis, ¢ (0) and a are uniformly 

bounded and so a(t) < K, a constant which is independent of wE W. 

Also, as before, we find that for t € [-2v), 2v\], a,(2 ar * - Zl < 
Z 

a, (=) exp (=, 4 « Hence, for zr >z 


OAs 
-2v, 
K 
a(x) > |(a, - €/2) -~ — 5(t) dt + 5(t) dt 
y f ‘ )- == | (t) (t) 
= 27 
avr 1 
exp ad aN Jon ( ) e 
~2v) 
Again, for fixed A sufficiently large and x > xe, A), a (x) 7 ee 


Therefore, since 2, and z, are independent of w EW, we conclude that 


1 


lim a (x) = a, uniformly for wE ‘WwW, || 
xo-P0o 


We now seek to apply this proposition with W=C w= PEC) and 
¢ p(t) = PAT» t). Clearly, sup {9 (0), FEC} <1 <©@ and we have 


already remarked that the Laplace integral 9 ,(8) = {6a 


8) converges 
for 8 with Re 8 > do = -28(e). As noted previously, Baa ¢) is inde- 
pendent of the parameter t and it follows from (10) applied to each 
FEC that els °) is analytic in {e: Re 8 >A, - 5} for some 6 > 0 
except for a first order pole at 8 = Age With this in mind, we prove 


several lemmas which will enable us to apply the previous proposition. 
Lemma 4.6. For any fixed FEC, 

a Gn 
lim Ppt, 8) - Ee = op) (8 =x + ty) 
xrhyt Fe 8-Ap F 
uniformly on every finite interval ly| < Yo» where ap and Jp are given 


by 


= =] ~Aq to 
(14) a,= tye B (Ap) 


F 
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a7 Ao%o a aa Mala 2 hp(aytty) y #0 
5) gp -y  ® ine 
oO tg IB L(g) ~ $B p(Ag)] + Ag) y= 0 
c 
where B,(8) = (1, Wo) | ¥ (YI, (dy, 8) and h,(8) is the function 
-c 


given in (11) applied to FEC, 

Proof. We denote the residue 52S °) at the pole 8s = Ay by ao 
If we write G (8) = PI, 8) - ap/(8&-r_) > then Gp is analytic in 

{s: Re gs > Ap - 5}. Hence, for 9 ply) = GpAgtty), the uniform conver- 
gence on finite intervals is an immediate consequence of the analytic- 
ity of G 


Straightforward computations show that a, and Jp, are given 


F* F 
explicitly by (14) and (15) respectively. We remark that the analytic- 


ity of Gr implies that J, is well-defined at y = ann/t)- II 


Lemma 4.7. For each y € [-c, c], for each k > 0, and fors =x + ty, 
O>xz>d) - 1/16, Inn cr, s)| < a i 2 DP, (Ls x + 1/16)| 
where D is a constant which is independent of F €C. 

Proof. We recall that I aty, ¢) is analytic in {a: Re 8 > A» - 1/16}. 
It is given explicitly in (5) (when applied to each FEC) and a simple 


calculation shows 


ie 
k . {0 ; 
ma) (y, 8) = 280 5 es! | (aps eset Pay, t) dt 
0 


Cc 

3 | [Q,¢7, N» t, ty )-@(y, n) ](-t)“e7? *P (dn, edt. 
0 “-¢e 

Thus, using Lemma 4.5, we see 

See ore + pka7 + a (6 


t)dt; 


eG e)| <2 z 
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the integral above is exactly Ee. (l,> = + 1/16)| as desired. Hl 


Lemma 4.8. For each kK > 0 and each 8 € {8: Re 8 > Ay} with s =x + ty, 
ae? ca, s)| <M, (x), a real-valued function which is independent of 
He 


Proof. First of all, if x = Re s > Q, then in ae s)| < 


P (lo. t) at <k! g kl, This is the desired bound for 


k ~-ct 
te PF 


0 
Res > QO, 

Now, for Re s < 0, we use the explicit expression for Pom 3) 
obtained from (10) and (11) applied to FEC, First, we obtain the 
bound for kK = 0. We note that Jer OmeentiaS > e7*0_240%0 for all gj > 0 


and x = Re gs > roe Also, integrating by parts and recalling that i = 
Cc, 

0(j), we obtain, using the previous lemma, that | ¥ (YIP (ay, s)| < 
-¢c 

K(t, + DP (Is 2 + 1/16)]g where K is a constant depending only one. 

As seen previously, (1, ¥.)| < (ally t = 21, and ) je < ©, 


Thus, 


ee 8) | < (x1 (e7*0_gh0%0)- Bi en Zorn + Km (rng O20 yas 1) 


eyes peer eee tae 


the constants being independent of FPF. If x + 1/16 > 0, then 
PAT, = + 1/16) < (& + 1/16)7! and it follows that PI, 8) is 
bounded independently of FP. Otherwise, we repeat the same process 


applied to Ue aes + 1/16) to obtain 
(one s)| < K,(z) + K,(@) PAI, = + 2/16). 


Continuing in this manner, we obtain for some m = m(x) > 0, 
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eg s)| <J(x) + K(x) Pi x + m/16) 


where & + m/16 > 0 and Jd and K are functions of x which do not depend 


on F, Hence, eee. s) | < d(x) + K(x) (x + m/16)7}, a function which 


is independent of F. 

To obtain the desired bounds for higher derivatives, we differ- 
entiate Beis s) [as given by (10) and (11)] and use essentially the 
same method as for kK = 0. We note that the infinite series of (11) is 
uniformly convergent on compact subsets of {s: Re 8s > Ay} and, there- 


fore, can be differentiated term by term. lI 


Lemma 4.9. sup {a,: FEC} <@, , 


rex 
Proof. Since a, =, ¢ §°'(1, y)| ¥o(y)I (dv, Ay)» it follows as 
-¢ 


before from Lemma 4.7 that an < K,)[t + DP ACL,» Ay + 1/16)]. Hence, 


by Lemma 4.8, a < Kg) [t, + DM) (Aq + 1/16)}; since this bound is 


E 
independent of FP, the desired conclusion follows. II 


Lemma 4.10. For any Yo > 0, the family {9 ps F €.C} is uniformly 
bounded and equicontinuous on [-y), Yq]. 
Proof. Let Yo > O be fixed. We note that since BOE °) is indepen- 


dent of the parameter boy» so is a, = lim (s-Ay) PEC» gs). Hene, 
s>r 
0 


since Ip'y) = Gp(Agtty) where G,(8) = PA,» s) - an/(s-Ag) Ip is also 
independent of ty. Therefore, since t) was arbitrary, it may be chosen 
so that 2n/t) > y, without affecting the Ip Ss Now, gp is given 
explicitly in (15); we write 9 ply) = u p(y) oa h pQotry) where 
B protty)-B, (Ay) 


1 1 
FF + Bg) : - 


et 4*0_y e401 tyt, 


“Ap to 





uply) = @ 


and hp is as before. 
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First, we show that g,(y) is bounded independently of Fe ¢ and 
y E[~Yo> Yy]- We write the first term of uy, as ({B ,(Agtiy)~B (Aq) J /y) 
. [(e°4*0_1) fy jm}. The second term of this product is continuous {when 
it is extended to equal (it,)7! at y = 0] on |y| £ Yq < 20/ty and, 
hence, is bounded. If we regard BA(A)+ty) as a function from [-Y¥ 9» Yq] 
to €, we see by the mean value theorem that for y 7 0, 
|B pAgtty)-B (Ag) I /y| < [B,"A,tiy*)|, 0 < |y*| < |y|, while for 
y = 0, the first term is defined to be 1B, (Ag) - Thus, using Lemmas 
4./ and 4.8, we see that the modulus of the first term is bounded 
independently of F and y. In a similar manner, the second term of u 


F 


is uniformly bounded and so, therefore, is u The fact that hp(Agtty) 


Pr 
is uniformly bounded follows by using again Lemmas 4.7 and 4.8. Thus, 
Ip is bounded independently of F and y. 

To show that {gos FEC} is equicontinuous on [-Yq > Yo]> it 
suffices to show that the derivatives Ip are uniformly bounded. Conm- 
puting these derivatives, we find, using the mean value theorem, that 
they may be bounded by expressions involving Tae (y, Agtty), k = 
O, 1, 2. Hence, it follows from Lemmas 4.7 and 4.8 that Fy are 


bounded independently of F and y. Therefore, {gp> FEC} is an equi- 


continuous family on [-Y 9» Yo]. II 


Theorem 4.1. Let € be a class consisting of distribution functions 


which satisfy properties (i)-(iv). Por FEC, let P, be the probabil- 


F 
ity measure induced on the space (Qs # by F and for ec > 0, let N Ae) 


be the stopping time defined above. Then, lim n® 62) p [N.(e) > n] =a 
F PF F 

N-ro 
uniformly for F € € where B(e) is a constant which is independent of F 


and Qo is the constant defined by (14). 
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Proof. It follows from the previous lemmas that we may apply Proposi- 
tion 4.3 to the family of functions {PC °), FEC} to obtain 


. _2B(e)t 
(16) Lin e PAI, t) =a 


F 
uniformly for F €C, We noted previously that PAL,» t) = 
Z 
P(N ,(e) > [e ve Hence, (16) is clearly equivalent to the desired 


conclusion, || 


As mentioned at the beginning of this chapter, we actually need 
to apply this uniform result to a collection of distribution functions 
indexed by the parameter yp. For each real yp in some neighborhood of 
zero, say lu | < Ug, let fy why be a sequence of i. i. d. random 


variables defined on the probability space (2, ¥ A Se with common 


u 
distribution function G, which satisfies properties (i)-(iv). We will 
write o(u)? for 0G". Further, we assume that as u>0Q, G converges 

weakly to G, (denoted by G. > Gy); i.e., Y,(u) converges in distribu- 


tion to Y, (0). Writing o* for 0(0)*%, we note that G — Go and 


35% (pn) | 3 <M together imply that lim o(y)? = 0%, Examples of collec- 
u+0 


tions of sequences satisfying these properties will arise in our 
subsequent work. 
Now, for each w and for every c > 0, we define the stopping 


time Me = M Ce) on the space (Qs ee Pp.) by 
n 
M,=M (c) = least n > 1 such that I} ¥,(u)| > eo(uyn 
1 
or + if no such nm exists. 


We note that a corresponds to NG, defined previously. We prove one 


additional lemma before the final theorem of this chapter. 
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Lemma 4.11. lim P (M >n) = Py (M > nm) for alln> l. 
wo iF HP : ~ 


Proof. Let m > 1 be a fixed integer. Defining the sets ete by 





B= (CY, vee - od? 


k 
v by | = eo(u) vk, k = 1,...,"}, we can write 
1 


PM >ny= |... | dey) ... dé). 
B 
i 


Since Gy is continuous except possibly at zero, the distribution of 
k 


bY. (0) can have an atom only possibly at zero. Thus, 


eee | dG, (y,,) eee dG, y,) mag 0 
0B ; 
where 9B, denotes the boundary of By. Since oe Go» it follows that 


lim ee dG Yy,) eee dG (Y,) = eee dG, (y,,) eee dG, (y,) 
uO B B 
0 0 
= Py (My > mn). 


Therefore, it remains to show that 


Lim | ca | ac ee dG (y,) - |... dG (y,,) Nes dG ty) | = 0. 

u>0 
B By 

v) 

k 


Denoting this absolute value by A(y) and writing 5.) = dy .(u), we see 
1 


that 


a(n) < P{|s,(H)| < cove, 1 <k <n; |S.(u)| > co¥G for some j < 7] 


+ P (ls, ()| < covk, 1<k <n; |S Cu) | > ca(u)vj7 for some j < nj, 


and, therefore, that 
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7% 
A(u) < } P leovk < |S,(u)| < cou) vk] 
(17) : , 
+) Piles(uyvk < |S, (u)| < cork). 
1 


Now, for any € > 0, we may choose uw sufficiently small so that 


lo(u) - o| <e. For such p, (17) may be written 


n 
A(u) <} P leovk < |S, (u)| < e(ote) vk] 
1 
(18) - 
+ } P [e(o-e) vk < |S, (u) | < cork}. 
au 


Recall that oF as Gy as u* 0 and that G) is continuous except pos- 
sibly at zero. If we first let w+ 0O and then let € + 0 in (18), it 


follows that lim A(y) = 0 as desired. I| 
u>0 


Before proceeding, we should remark that in order to insure the 
convergence asserted in this lemma for every m > 1] and every ec > 0, 
something like the hypothesis that Gy is continuous is necessary. For 
example, consider the sequences of i. i. d. random variables 
ee) } oy \u| <1, where Prob{X, (u) = l+y) = = and 
ProbiX;(u) = -14u) ==". Then, EX,(u) = 0, BX,(u)? = ou)? = 1-02, 
and E|X,() |? = 1-y* <1. Also, if a is the distribution function of 


XQ)» then it is clear that Fe , Fy as u + 0; however, Fy is not 


continuous at tl. If the stopping time M '(e) is defined by 
n 
M ‘(ed = least m > 1 such that |} X.(u) | > co(u)yn 
1 
or +e if no such ” exists, 


then, for ec = l, 
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PUM!) > poe n= 0 
-- <0 
Thus, lim P tM '(1) > 1) =: # Pi(M,'C) > 1). 


u>0 
Finally, we prove the theorem which we will need in our 


subsequent work, 


Theorem 4.2. For each real y such that |u| < Wy, let {yw} be a 
sequence of i. i. d. random variables defined on a probability space 

(2 Fy Eo with common distribution function Gq, such that G. satis- 
fies properties (i)-(iv) and G, > G, as wp +0. If for any positive 


Cy 
1 
M(e) = least n > 1 such that Id ¥,(u)| > co(u) en 
1 
or + if no such nm exists, 


then, for each @ > l, there exists a positive integer no and positive 


constants a, and a,» all independent of w, such that 


] 


for all m > m) and all uw sufficiently small. 
Proof. Let us consider the class of distribution functions 


{G luj < Uys. We noted that M (ce) corresponds to N (ec) and, there- 
v1 


fore, by Theorem 4.1, 


B (ae) 


(19) we n P [M, Ce) >nj = a 


uniformly for |u| mele where we have written et for the constant aos 
ul 
If we take the limit of both sides of (19) as y + 0, the uniform 





} 
al 


convergence justifies interchanging the limits and, so, by Lemma 4.11, 


lim aC = @)- 
uO 
Let € > 0 be given such that a, - € > 0. Then, for all u 


sufficiently small, a, - €/2 < a, <a, + e/2. Also, there exists an 


0 


Nn , independent of w, such that for all nm > m, and all w with [ul <u, 


Be) 


a -e/2 <n P (M >n) <a +e/2. 
" [2 < yy IM, Ce) icy / 
Hence, for all w sufficiently small and 1 > Ny» 


(20) a, -€< n®‘°)D Im (e) >nj) < a, + €. 


Taking a, =a, -€ and RF + ¢€, (20) is exactly the desired 


result. II 





CHAPTER 5 


RANDOM VARIABLES HAVING MOMENT GENERATING FUNCTIONS 


AND CONTINUOUS DISTRIBUTIONS 


We have just obtained uniform bounds on the tail probabilities 
EM > nm) for a stopping time a associated with a certain collection 
of distribution functions indexed by a parameter yw. In that case, each 
distribution was assumed to have a zero mean. What we wish to consider 
now are certain sequences of i. i. d. random variables of the form {x} 
where x. = x + wu, EX, = 0. In this chapter we will determine the 
behavior of EN as n + 0 where N is a stopping time defined on the 
sequence {x}. 


To do this, we write PW >n) = dP where me denotes the 
B 


joint distribution of xy» Shoe x In order to apply the results of 
Chapter 4, we will define a new distribution function oe and an associ- 
ated sequence {Y 3 such that G has zero mean and is absolutely contin- 
uous with respect to Pa the distribution function of X\- In fact, if 
we assume that the moment generating function ¢,, (6) of F exists, then 


we can write 
dp” _ i 
(1) y =) = [o (A) ] exp i } =,] agi (z) 


where x = (2),...,2,), qr is the joint distribution of Y,, ..., Y, and 
h is such that ¢,' (-A) = 0. The assumption of the existence of a 


moment generating function is rather strong; however, it is this 
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condition that guarantees that the density in (1) is such that it can 
be bounded on the set B in an appropriate manner. ‘The desired result 
then follows using the techniques employed in the proof of Theorem 3.1 
for the normally distributed case. 

We begin by investigating a certain collection of distribution 
functions. For each real y in some neighborhood of zero, say | uw | < 
i , let F. be a probability distribution function satisfying the 


following properties: 


(i') x dF @) =m(u) #0 for p # 0, m(0) = 0 
(id) [x—m(u) }7 dF (2) = a(u)* < ~, o(u)* > 0 
(411) @ (t) = ha dP (x) <M, <© for |t| < 2r 


(iv') F is continuous. 


In (iii'), M, and r are positive constants which are independent of nu. 
Further, we shall assume that Fs , PF, as uw > 0, An example of such a 
collection is {F} where F (a) = P(x-y) and F is a continuous distribu- 
tion function having zero mean and a finite moment generating function 
in a neighborhood of zero. This is exactly the case we wish to 
consider; however, with the more general hypotheses, we are able to 
obtain a result (Theorem 5.1) that will be useful not only in the 
special case but also later in Chapter 6 as well. 

We will assume, without loss of generality, that the moment 
generating functions mn are finite in an open interval containing 


(k) 


[-2r, 2r] so that " EC [-2r, 2r}. We recall that o (t) = 
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xk 


tx 
e dP (x). An important consequence of the boundedness assump- 


tion in (iii') is given in 


Lemma 5.1. If $0) <M, for |t| < 2r and |p] < u,', then for each 


k > 0, the family oO, |u| < u,'} is equicontinuous on [-r, r]. 
(k~1) 
“ur 


Proof. By the mean value theorem, we can write 


(k-1) (k) 
* 


(t5) Po 


(t*)(t,-t,), k > 1, where -2r < t,; < t* < t2 < 2r. 
(k-1) 


(t)) = 9) 


Hence, for each kK > 1, in order to prove that {9 , ul < u,'} is 


(k 


equicontinuous, it suffices to show that oe ) | w | < ui") is unifornm- 


ly bounded on [-r, r]. 


We note that Jo ce) | < |x|“ Bg dP (x). Also, the 


ee | x | 


function |x is bounded on the real line and, so, for some 


js r|x| 


constant K, |x|" < Ke Thus, Jo, ce) | iS Rigs (oor) Ce es 


2KM, for |t| <x. This is the desired uniform bound. ll 


We also make note of several consequences of the assumption 


that Fi + F,. First, just as in the previous lemma, we can show that 


|x|? dP (x) < 2KM, for some constant KX. Hence, it follows that 


=O 


m(u) + m(0) = 0 and o(p)2 + o(0)* as wp + 0. Further, we may write 


$ = Ae dP (x) - ar dP (-£) 5 i.e., My may be regarded as 
0 0 
the difference of two Laplace transforms. As such, since oa is bounded 


for || < 2r, it follows from the continuity theorem for Laplace trans- 


forms [9, p. 433] that P — F. implies that lim $ (t) = $,(t) for 
u 0 HM 0 
u>0 
each t, |t| < 2r. 


Now, for each wp, | | < Ma's there exists a probability space 
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(2, ; a) and a sequence of i. i. d. random variables (xu) f 7 


yu n=] 


with common distribution function Ee We define the stopping time N = 


pace) on the space Se Pp. for all positive ec by 
n 
No = W (ec) = least m > 1 such that |) X,(u) | > co(u)yn 
1 
or +@ if no such nm exists. 


We wish to obtain bounds for sae > n) for large m which hold uniform- 
ly for all w sufficiently small. To do this, we wish to define a 
collection of distribution functions, indexed by the parameter yu, which 
satisfy the conditions of Theorem 4.2, 

We note that $, (0) = ], $, ' (0) =m(0) = 0, and 9° (0) = (0) > 
0 {implying ¢, (é) > 0 for all tj; hence, it follows that $, (t) > 1 for 


all t¢ #0, [¢| <r. Thus, since lim ¢, (%) = o, (2) for || < 2r, we may 
u>0 


choose { w | sufficiently small so that ¢ (cr) > 1 and on) > 1. Since 
$9) = 1 and o, (2) > 0, we conclude that for all |u| sufficiently 
small, there is a unique number h(y), |r(u)| < r, such that ¢, (-hG) ] 
= 0; of course, h(0) = 0. We will write h for hk(y) when no confusion 
will arise. Henceforth, we will only consider p in a neighborhood of 
zero for which A(u) as defined above exists, say |u| < u, where, 
without loss of generality, w, < u,'- 

We now make use of a transformation due to Esscher [7] to 


define a new function G3 i.e., for lu <Uy,> 


y 
1 -hx 
GY) = 4, CAD e dP (x) . 


oe GO 


It is easy to see that oo is a continuous probability distribution 


function. For each n, | w | <u,, there exists a probability space 
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a ; fee) and a sequence of i. i. d. random variables {Yu} 
with common distribution function Si We note, in particular, that 
Gy = Fy; hence, we will assume (25°, *o', P,') is the space 
(Qos Fo» Py) and that ¥ 60) = X00). We now show that the collection 
{G , [ul < uy} and the associated sequences BACT ul < uy} 
satisfy the conditions of Theorem 4.2. 

We denote EY, (u)? by t(u)? and write t* when no confusion will 

arise. Also, we write o* for 0( 0)2 = 1(0)*. For future reference, we 
let v(u) = -log ¢ (A). The next lemma gives the limiting behavior of 


on), +)*, and v(p). 


Lemma 5.2. As np > 0, ACU) ~ m(u)/o2, t(u)2 > o?, and v(y) % m(u)*/207. 


Proof. First, we show that lim h(u) = 0. Let € > O be given. Then, 
u+0 


since for each fixed t, |t] < 2r, lim o ( t) = 6 t) and ¢ (t) > 1 for 
u>+0 


t # 0, there exists a 6 > 0 such that for |u| < 4, ¢ Ce) > 1 and $ fe) 
> 1. Since ¢ (0) = ] and the minimum of ee occurs at -h(u) and 9$' is 
strictly increasing, it follows that -e < -h(u) < € for lu <6 icon 


lim h@) = 
u+0 
To obtain the asymptotic behavior of h(u), we express ¢ Ct) as 


the power series 


= t” n+1 
Oe(t) = mu) + [o(u)> + Ge)" 12 ee 
U 9 ne u 


By the definition of h(y), ¢ [A u)]) = O and, therefore, 


2 2 2 eo Re 
m(u) = he[o (w)2+m)?) - h L dF (x). 


The series of higher-order terms above has an absolute value not 





ah, 


greater than the integral |x| 3 on aF (x) which, as in Lemma 5.1, 


—o 


is bounded independently of py. Hence, lim m(y)/h(y) = o2 or h(p) © 
u+0 
m(u)/o2 as p > 0. 


2 ee seed 
Next, t(u)" = EY, (u)* = | y? de (y) ” oChy 


—oO =O 


Thus, t(u)2 = ¢"E-ACw)1/¢ [-AG@)]. Since both fo, [ul] < u,} and 


Voom dF (y). 


{o "; ul < u,} are equicontinuous families, it follows easily from the 


fact that h(y) > O that ae > 5 (0) = o% and i > >, (0) = 1; 


hence, lim t(p)2 = o@. 


u>0 
Finally, we consider v(y) = -log ¢ (-A). We write 


-log ¢ (-h) log ¢ (-h) ¢(-h)-1 h2 
(2) ne Sapo Caw . 
m(u)2 $ CA)-1 -h? m(u)2 





Also, we express Gt) as the power series 


fae) 


2497 Z = -h n 
6 Gh) = 1 - fn(u) + teeny") 2 + CA x"dF (ec). 


= 


Now, since lim zo 8 = 1, the limit of the first term on the right 


u+0 
in (2) as 1 > 0 is 1. From the power series expansion, the limit of 
the second term as p + 0 is o% - 02/2 = 04/2. By the first part of the 
proof, h2/m(u)* + 1/o* as p > 0. Thus, lim [-log 9 (-h)/m(p)2] = 1/207, 
u>0 

and, so, v(u) ~m(u)2/20% as desired. || 

Let vt) be the moment generating function of ¥,(u). From the 
definition of Go it follows that Fee) = oe at) and, so, oe is 


Minite for |t| < r. 


Lemma 5.3. a RI ee cle | ea 0. 


Proof. It follows from the equicontinuity of { |u| < ut that 
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$ (é-h) + $)(¢) as u + 0; hence, lim v (4) = $,(t) for all ¢, eo U sare 
Therefore, a ivy Fy. on ll 
Lemma 5.4. For all uw sufficiently small, say |u| < Wy» (a) EY, Gu) = 0, 
(b) O< m, ScEY Gn) < ©, and (c) Ely, @)|? < M where m, and M are 
positive constants which are independent of u. 

Proof. For (a), EY, (u) = Ue SU) = oh) /d CA) = 0. Next, we recall 
that EY, (u)* = t(u)* + o% and 0 < of < @; therefore, for any My» 

0 < mM < 02, we will have m Seen < © for |u| sufficiently small. 


Finally, from the definition of Ga we see that 


ain 1 3 Ay 
(3) E|Y,(u) | = $(-h) ly|? e dF Cy). 


= UL) 


Since Me) > 1, it follows that eta + for lu | sufficiently 
small. Also, as in Lemma 5.1, the integral in (3) can be shown to be 
bounded by 2kM) where K is a constant, independent of nw, and M, is the 
bound in (iii'). Thus, for M = 4KM Ely Cu)|° < M for lu suf ficient- 


ly small. || 


The preceding lemmas show that iG, | u | < Hy} satisfy the 
hypotheses of Theorem 4.2. Hence, if we define, for any positive d, 


the stopping time M (a) on the space (QF : Pp.) by 


u 
n 

M (d) = least n > 1 such that |) Y.(u) | > dt(u)vn 
I 


or + if no such ” exists, 


then it follows that for each d > 1 there exists a positive integer 


No nN, (a) and there exist positive constants a, and a, [a, = a,(d), 


a 


> a,(d)], all independent of ww, such that 
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(4) an 6%) < PIM, (@) > nj < a,n *() 


for all m > mp and for all yu sufficiently small. 


We are now able to obtain the desired bounds for P{W (2) Spe 


Theorem 5.1. Let F, |» | < Uo} be a class of distribution functions 
such that each function in the class satisfies properties (i')-(iv') 
and F, “+ Fy as » +0. For |u| < up, let P, be the probability 
measure induced on the space (Q F) by E and for @ > 0, let N Ce) 

be the stopping time defined above. Then, for each ec > 1 and any 6 > 0 
such that c-6 > 1, there exist positive constants a, = a, (ce) and ad = 


a, {c) and a positive integer all independent of uw, such that 


a, (4, (-h)"e" | (e-8) tH, Ble-8) < P [W (ce) > 2] 


(5) < a, (4, (-h) Jel Al (et8)e¥n,-B(e48) 


for all m > mp and all » sufficiently small where h= h(p) andt = t(p) 
are as defined above. The upper bound also holds for ¢ = 1 and any 

§ > 0. 

Proof. Let ec > 1 be fixed and choose 6 > 0 such that e-6 > 1. As 


noted above, lim t(y)* = lim o(u)* = o% and, therefore, for y suffi- 
+O 170 


ciently small, |eo(n) /t (un) -~o| <6, If we define the sets 


k 
B = he ee |} z,.| < co(y) rk, K = liees gh} 
1 
‘ k 
B= { (2, 5-2-2): |} x. | < (c+) tk, Kis 1,2... ,n} 
1 


k 
Be { (15 ++-,%,): p x. | < (e-8) tk, KY Ae icccsog Ce 


_ + 
then for all yw sufficiently small, B CBCB. 
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Now, Ete) >nj = sane aF (,) Sie dF (z,); and, so, 
B n 
h)x. 
n 1 
(6) P UW Ce) > nj = [¢ (-A)] wee | fe dG, (x,,) fam dG (x). 
B 


Thus, for all yw sufficiently small, P WW Ce) > n}] is bounded above by 


the right side of (6) with B replaced by B* and is bounded below by 


n 
the right side with B replaced by B . Using the bounds for ) x on BY 
Hi 


and B and the definition of M (d), we obtain 

_|h| (o-8)<vH 
M -§6 

Pil le ) > n] BS CS), > n| 


neliCet8)t¥Mp ty ¢ o48) > nj. 


[6 (-h) ]"e 
< (6, (ch) ] 


Combining this and (4), we find that for a, = ae-s), a, = a, (ets), 


and nm. = max in, (e-6), n (e+d)}, (5) holds for all n > n, and all 4 


0 0 


sufficiently small. 
We note that if ec = 1, then c+é > 1 for any 6 > 0. Hence, the 
right-hand inequality of (4) may be applied for d = e+é6 to obtain the 


desired upper bound as above. II 


In Chapter 3, we studied a stopping time defined on a sequence 
of normally distributed random variables with nonzero mean. Now, we 
wish to find bounds for the expectation of the same stopping time 
defined on a sequence with a more general distribution. Let us fix a 
distribution function F that is continuous and possesses a finite 
moment generating function in a neighborhood of zero. Further, if 
ay, is a sequence of i. i. d. random variables defined on the prob- 
ability space (2, ¥, P) with distribution function F, we assume that 
EX, = 0 and EX,? = 92 < , g4 > 0. For each nonzero uy, we may define 


~~ 


the random variable x, = XM) on (2, F, P) by setting x. = Xn + U. 
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Then {x} is a sequence of i. i. d. random variables with common mean jy 


and we obtain the following result. 


Theorem 5.2. Let Ca be the sequence of i. i. d. random variables 
defined by x = x + y where x has the distribution function F; i.e., 
{x3 is a sequence with common nonzero mean yu, finite, positive vari- 


ance o2 


» a continuous distribution function, and a moment generating 
tx 
function Fe”! which exists for t in a neighborhood of zero. If for 


any positive ec, 
n 
N(c) = least n > 1 such that |) x. | > covn 
1 
or +” if no such 7 exists, 


then for each c > 1 and for any e€ > 0, there exist positive constants A 


and B, independent of w, such that 


-2[1-B (ce) ]+e a2 Le BCe =e 


Alu | < EM(e) < Blu| 


for all sufficiently small yw. The upper bound is also valid for ec = l. 
Proof. For each small u # 0, x = x + p has a distribution function 
a8 defined by PCa) = F(x-y); i.e., Ee is a translate of F. Of course, 


tx) . eM s (t)s hence, say for | u | < 1, the functions oF are 


$ (t) = Ee 
clearly uniformly bounded on any finite interval containing zero on 
which $¢,) is finite. Thus, {F lu | < 1} satisfies properties (i')- 
(iv') with m(y) = uw and o(p)* = o2. Also, clearly, eee as yp > 0. 

Let @ > 1 and e€ > O be fixed. Since £8 is a continuous function 
of e@ (see Appendix), there exists a 6 > O such that c-6 > 1 and, for 


all d for which |e-d| < 6, |B(e)-B(d)| < €/2; in particular, @(e-5) < 


B(c) + e/2 and B(e+d) > Ble) - e/2. Fixing such a 6, we may apply 
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Theorem 5.1. 
First, we shall consider the upper bound. Since @ > | and 
6 > 0 have been fixed, we shall write J, a and B- for N(e), BC ets), 


and B(¢e-56), respectively. Then, from (5), 


% + 
(7) EN <n, +a, y (6 (-n) Ie!" (c+6)t Yn, -B 


9 
for all uw sufficiently small. 
Recalling that v(u) = -log CA), we write [o,(-A)" - 
ee et f,@ = 2 ay glh|(ct8)tv= -8" By Lemma 5.2, 
h~ w/o* and viv) © y2/202; thus, [|r| (e+6)1]*/v(u) + 2(e+6)% as wp > 0. 
Also, we note that v(u) > O for uy sufficiently small and that g* an EP 


Hence, it follows from (7), using Lemma 3.1, that for yp sufficiently 


small 


(8) EN < ny + a, fede + K(y) 
0 
where K(y) + O as yo. 


Performing the change of variable y = u*x, we see that 


: yv(u) = [A|t 
- + 








role i 
Ff, @e)de = oo ae exp|- Gren lies dy. 


2 
0 0 v 


u 
For each y € [0, ~), the integrand on the right converges to 


y Cro 5 


ap |— Se Vly as up > 0; for sufficiently small yw, the inte- 
20% fe) 
y 2(e+6) oat 
grand is dominated by exp |{- —> = Wale B . The latter function 
46 fe) 


is integrable, the value of the integral being given explicitly in [10, 


p.- 337]. Hence, by the dominated convergence theoren, 


@ [o°) 


2 _ + y até _ +. 
(9) fede vy 208) exp |- ——-4 —="¥gilgo” aaae 


2. 
0 0 20 oO 
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the integral on the right having a finite value since g* < 1. Finally; 
combining (8) and (9), we find that there exists a positive constant B, 


for example 


oD 


y c+é -g 
B = 2a, exp |- —- + — vyly ” dy , 
0 20 0 
-2(1-8") 
such that for u sufficiently small, EN < By - As noted above, 


a 


feelin Ie as desired. 


= B(ce+d) > Ble) - €/2. Thus, EN < Blu 
We note in the case c = 1, the upper bound of Theorem 5.1 

remains valid. Recalling that §(1) = 1, we are able to use the same 

methods to obtain ENW(1) < Bu for all uw sufficiently small. 

For the lower bound in the case that e@ > 1 is fixed as before, 


we obtain for all uw sufficiently small, 


EW > a, ) onv(u) ,-|h| (e-8) t¥n 8 
n 
0 


og tvu) -|h| (e-8)t¥e-B a. 


[Vv 
» 


nq 
S28) 1) |e lal 
= P 


1 2 
wen, u u 








(e-5)vyly ~ dy . 


Denoting this last term by J(u), we find, again, by the dominated 


convergence theorem that 


as up > 0, where, once more, the integral in this expression has a 
finite value since 8 <1. Thus, there exists a constant A, e.g. 


CES 
As— exp |- —- - — vyly B ay, 


0 


such that for all uw sufficiently small, EN Syitieswe: ) and, there- 
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fore, since B = B(e-5) < B(c) + e/2, EN All 7 Hi 


We remark that the conclusion of this theorem is equivalent to 


the statement that 
log EN(e) ~ [1-B(e)] log yp? 


as u > 0. 





CHAPTER 6 


SOME GENERALIZATIONS 


Breiman obtained the asymptotic behavior of certain tail prob- 
abilities for a stopping time defined on a sequence of i. i. d. random 
variables which were assumed to have a finite absolute third moment. 
In obtaining bounds for the expected value of this stopping time in the 
nonzero mean case, we have imposed additional restrictions on the con- 
mon distribution of the sequence. We now seek to weaken some of these 
more restrictive conditions. Some results in that direction are pre- 
sented in this final chapter. 

If we drop the assumption that the random variables have a 
moment generating function, we can prove that the lower bound remains 
valid. Further, when the moment generating function exists, we can 
prove easily that the upper bound holds even when the common distribu- 


tion function is not necessarily continuous. 


1. Lower Bound 
First, let us consider a probability distribution function F 


having the following properties: 


(i'') x dF(x) = 0 


(ii") x? dF(x) = 02 < », o% > 0 
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(iii") jx]? dF(z) < @ 


(iv) F is continuous. 


It follows from (i") and (ii") that 0 < F(O) < 1. For future refer- 


ence, we identify the following three points: 


x, = inf {x: F(x) > F(0)} 


] 


x, = sup {x: F(x) < 1} or +~ if {x: F(x) < 1} = R} 


2 
Lo! = inf {x: F(x) > 0} or -~ if {x: F(x) > 0} = RM}. 


We note that -™ < z,' < 0 88 63 < x. < +, 


fa 

For any u # 0, we define the distribution function Es by P(x) 
= F(x-u); i.e., i is a translate of F. If x is a random variable 
defined on the probability space (2, #, P) having as its distribution 
function F, then Pe is the distribution function of X+u; we write X = 
X(u) = Xtu. Property (i") above implies that EX = 0 and, therefore, EX 
=u. We now wish to study a sequence of i. i. d. random variables with 
common distribution function Hs If N is the stopping time associated 
with such a sequence, we obtain a lower bound for P(W > n) of the form 
P(N’ > n)P(W"” > n) where WN’ is a stopping time defined for a sequence 
of bounded random variables and WV” is a stopping time defined for a 
sequence of random variables with zero mean. We can then apply the 
results of the previous chapter to WN’ and Breiman's results to W” to 
obtain the desired conclusion. 

To get this type of bound, we first express X = X(y) as the sum 
Y + Z where Y is a truncation of X and Z is a random variable with zero 
mean. Although this is not difficult to do, we also wish to insure 


that VarZ is small and that the truncation points converge as uy > 0. 
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The details are presented in the following two lemmas. 


Lemma 6.1. For every a, Z, <a < 2x,, there exists a corresponding 
a' < Q such that if 
7 X a’'<X¥<a 
vale 
0 otherwise , 
then EY = EX = 0. Further, given 6 > 0, @ can be chosen so that 


Var(X - ¥Y) < 6. 


Proof. Let a, xz, <a< 2x,, be given. If we define the function g by 


1 a 


a 
gly) = x Omtx) , 
Y 


then we note that g is continuous and nondecreasing for y € (-™, 0]. 


Further, g(0) > 0 and lim g(y) < 0. Defining a" = sup {y: g(y) = 0} 


yr-0 
and Y as above, it follows immediately that EY = Q. 

We remark that for each a, the definition of the corresponding 
a' insures that it is a unique function of a. It is also clear that as 


a¢+zx,, a' + x,'. Thus, since 


a! Xo 
Var(X - Y) = x* dF(x) + x* dF (x) 
Lo x, ' a 
and o% = xt adF(x) < », it follows that given 6 > 0, a@ can be 
x," 


chosen sufficiently large so that Var (X - Y) < 6. | 


Remark. If a lies in an interval of constancy of the function F, 
without loss of generality, we will henceforth assume that a is the 
left endpoint of such an interval; i.e., if F(a) = a, then we choose (a 
possibly new) a = inf {x: F(x) = a}. Given such an a, we have just 


noted that there is a unique corresponding a'. We shall then speak of 
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the pair (a’, a). 


Lemma 6.2. For any 6 > 0, let the pair (a', a) be such that Var (X ~ Y) 
<6, Then for all yw with lu sufficiently small, there exist numbers 
Ly = Zy(u) and x" = zy'(u), 2° < 0 < 29, such that 
(a) if 
X(u) zy'(u) tu < X(u) < 2)(u) + u 
Y* Y(y) = 
0 otherwise 


then EY = EX = y; 


(b) lim xy‘ (u) = a' and lim Zo (u) = a; 
u>0 u>0 


(c) Var(X - Y) < & for |u| sufficiently small. 
Proof. First, we consider the case where uy > 0. For all such y, let 


Ly (u) = a and write 
aty 
9,,(Y) = x dF (x). 
yty 


The function 9, is continuous and nondecreasing for y € (-~, 0]. We 


note that 
a 
gH) = xz dF(x) + u[F(a) - F(y)]}. 
y 
Thus, for uw sufficiently small, SU > p and lim 9, () <u. Hence, 


a 
letting x,‘ (u) = sup {y: gy) = uw}, we see that if 
ef x + u<X <a +4 
0 otherwise , 
then EY = y = EX, 


We note that for the given pair (a"', a) and each u, zy‘ Cu) is 
a 


uniquely defined. Further wp = EY = (c + yw) dF(x) and, so, 





69 


Zo! 
-~ x dF(x) = np[l - F(a) + F(z") ] 
a a’ 
since x dF(x) = 0. Noting that the right side above is greater 


a’ 


than zero, we see that xy") > a’ for all (small) » > 0. Also, since 


the right side is less than or equal to 2p, it follows that 
v 
“0 
uror 
Recalling that a’ was chosen so that it was the right endpoint of a 


possible interval of constancy, we conclude that lim x,‘ (4) =a’, 


urot 
Next, for up < 0, we choose zy‘ (un) =a’. For -p sufficiently 
small, we can show as above that 
yt 
zy (u) = inf {y: x aP (x) = y} 
a'+y 


is well-defined and is the number desired. Also, as before, it follows 


that lim zy Cu) = Q, 
u>0~ 


Finally, we see that 


Dat oo 
0 
Var(X - Y) = x2 dF (=) + x? dF (=) 
~ Xo 
x! oo 
- x? dF(x) + | «* dF(x) - u*[1-F(@,)+F(z,')). 
a Xo 


It follows from the convergence of the truncation points that 


lim Var(X ~ Y) = Var(X - Y) < 6. Thus, for |p| sufficiently small, 
Taal) 


Var(X ~ Y) < 5, II 


Henceforth, we will always assume that a pair (a‘', a) has been 


chosen and is fixed. Later, we will introduce certain restrictions 
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that will determine how large a must be, 

Next, we consider several sequences of random variables and 
make use of their independence to get a lower bound for P(N > n). 
First, we define three additional distribution functions. Let H(z) = 
PX < x | a < X <p), H (a) = P(X <x | X <x)! or X > ro), and let 
A be the distribution function of the indicator function of the event 


{x, : 


< X < x}. Of course, these distribution functions may each be 
expressed in terms of ee 

Then, we can consider random variables X’', X", and y (defined 
on some probability space) so that these random variables are mutually 
independent and have distribution functions Hi, A, and Hs respective- 
ly. We again let Y denote the truncation of X corresponding to the 
pair (xo' xy) as in Lemma 6,2, and let Z=X-Y. If E, and &, are 
two random variables having the same distribution, then we write 


E, = E>. 


Lemma 6.3. yxX' 2 y, (a-y)x" 2 z, and yX' + (1ey)x" 2 x, 


Proof, The lemma is proved by simply calculating the distribution 
functions of yX' and (l-y)X" and that of their sum, Let Pr denote the 
probability measure on the space on which the given random variables 
are defined. Using the independence and the definitions of ae and His 


we find that 


Pri < x) aePr(yX' < x, yee 1) + Pr(yX' < x, yert0) 


a IEC CRS AREA ese KS ol) a oerl (x) (P(X < x.') + P(X > x))] 


0 [O, =») 


where I, denotes the indicator function of the set A. Recalling that Y 


is just the truncation of X, we see that yX’ 2 Y. 


In the same manner, (l-y)X" 4 Z, and, also, 
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yX' + (ley)x" 2 Xx, ll 


Now, given the distribution functions ae ie Hi, and H as 
above, there exist, for each u, probability spaces (2., ¥,, Peds t= 
1, 2, 3, 4, and sequences of i. i. d. random variables {xX (u)}, 


{x '()}, x") t, and fy (u)} defined on the respective spaces such 


that X,(u) 2x, Xu) 2x", Xu) 2x", andy (u) 2y. Le the 
product space of the four spaces above is denoted by (Qs Fs ae then 
we can assume that the four sequences of random variables are defined 
on the same probability space and that the sequences are mutually 
independent, 

Also, we define the sequences of random variables {¥ (uy } and 
{2 (u)} by 
xX) typi < X (Cu) < 2p 


YW = 


and ZM) = x (u) - Y,(). Henceforth, we shall omit the dependence on 


0 otherwise 


u when writing these random variables [e.g., we write x for Xu) 1. 
We denote VarZ, = Var(X, - Y,) by 6 (u)? and VarX,’ by 3 (u)?. 
It follows from Lemma 6.1 that given 6 > 0, @ can be chosen sufficient- 


ly large so that 6 (0)? < 6%, In addition, we prove 


Lemma 6.4, lim aD ie = 9g, 
arr 2 


Proof. For fixed a, 2, < a < x, X1’(0) has the distribution function 


H Thus, 


0° 
a 
Dan 1 2 
0 (0) F(a)-Flaty x“ dF(x). 


a! 


As noted in Lemma 6.1, a’ + x)’ as a + x, and, by definition, 
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F(x, ‘) = Q and F(x.) = | since F is continuous. Thus, 


1 
F(x,)-F(xy") 
2 Xo! 


lim a (0)? x? dF(x) 


arr 


- x? dF(x) = o%. | 


Finally, we are prepared to introduce the stopping time whose 
first moment we wish to study. The i. i. d. sequence {x} has a common 


2 


continuous distribution function Pa and EX, =U, Varx =o“, and 


E|x | < ©, For this sequence, we define, for any positive number ec, 


the stopping time W = W(e) on the space (QF, Pp, by 
n 
N = N(c) = least m > 1 such that |} x, | > covn 
1 
or +” if no such m exists. 
We now wish to obtain a lower bound for EN(e@) when |u| is sufficiently 
small, Recalling that EN(c) = ) P le) > mj], we consider the prob- 
0 
ability P LW (e) > nj) for fixed n, 
Lemma 6.5. For any n, 0 <n<a, 
k 
P(W(c) > n] 2 P. [} x,"| < (e-n)ovk, kK = 1,...,7 
(1) : 
me p Z| < novk, k = 1,...,n]. 


Proof. Let n, 0 <n < ¢@, be fixed, Then, since x. 2 YX! a (1-y x5", 


covk, Ke lcs yt 


fA 


k 
PW >n) =P p x. | 


fA 


k 
aa Sy" (e=n)avj, l<jcn; [YCl-v, x," < novk, l<k«n|. 
1 1 
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Letting 


k 
A, ~ {12 YX, "| < (e-n)ovk, k =e 


k 
BS as 12 (1-y,)%,"| = novk, ns Te Wael 


we may write Pw >m) > P (AO BL). 
If S. = {gs = (By, +0058)! 8, = O or 1, 1 <7 < n} and if ris 
the random vector Tos (Vp see eT)s then 
CLIO) 2 ) P(A, VB, |r e)P (I, = 8). 
s8ES 
n 
For a particular term in this sum, suppose Sy = (81 400658) where ore = 
< ty < vee <4 <m, and 6s, = 8. = eee = 
| 2 Pons 


di J2 
8; =0, 1 <4, < 5 < gees Iq <nwithp + q=n, Let 


k 
C, = {| ) x. “| < (e-n)ovt,, K = Weert ts 
m=l1 om 


k 
Cot ALY x; 1s novdy k= Lyeeesat 
m=l1 “m 


Then it follows from the mutual independence of {x "}, {x "}, and it 


that 


PA, OB, |T, = 8)P (1, = 8) =P AB IT, = 8o}) 


= PC, MC, Qa — 65) 


P (C\)P (B, Ail, = 89}). 
Now, we note that ty > k and, therefore, 


k 
Gea Pe | } x, "| < (e-n)ovk, k = 1,...,p]. 
m=l1 om 
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However, since the oe are identically distributed and p < 7m, the 
k 
latter is not less than P || ) xl < (e-n)ovk, Re=Al 5.25.5?) ence, 
ML om=1 
> 
eu n) 2A ae BY) 


w= wes Pi(C)P BO (r = g}) 
nN 


k 
>P IY X,'l < (o-ndovk, k = 1,...,n)P (B). 
m=] 


k 
But (1~y,)X," D Z, and, so, P(B,) = P. It Z| < novk, k= 1,...,n]. lI 
1 


Theorem 6,1, Let (ee aie be a sequence of i, i. d. random variables 
with EX, = uy #0, Varx, = con E|\x,\? < , and a common distribution 
function which is continuous, Let W(c) be the stopping time defined 
above. Then, for each c > 1 and any e > 0 such that B(c) + €/2 < 1, 
there exists a positive constant A, independent of w, such that for all 


w sufficiently small 


EN(e) > Ais ae 


Proof. Let us fix a number c > 1 [hence, B(c) < 1] and fix an € > 0 
such that B(c) + €/2 < 1, Before proceeding, we place restrictions on 
the parameters n, 6, and a that we will need in the course of the 
proof. First, we fix n > 0 such that (a) ce-4n > 1 and (b) B(e-4n) < 
B(e) + €/4, Next, we fix 6 > O such that (c) no/éd > 1 and (d) B(na/6) 
< ¢/4 [recalling that B(u) + 0 asu+ +), Finally, we fix a suffi- 
ciently large so that (e) Var(X - Y) = 6 (0)? < 6% and (f) o/o (0) > 

1 = n/(e-n). Lemma 6.4 and the remark preceding it imply that such an 
a exists, 


Now, EN(c) = EWN = ) Pw > n) and, so, by Lemma 6.5, we study 
0 
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k k k 
= ’ <_ = 
Ps i} Z.. | < novk, k = 1,...,”{ and Ps p x. | Ske n)ovk, Ko eee tet lee 


We consider, first, the sequence {Z}, recalling that Ze =x 
2 _ 7 . 2 
Zu) x) Yo). We note that EZ 0 and VarZ 5) . In 


the proof of Lemma 6.2, we showed that lim 6 tu)? = 6 (0); hence, for 
yu+0 


O<m< 6(0)*, 6 Cu)? >m for wy sufficiently small. Also, for 


Ju[ <1, BIZ [3 < e[x @ |? < |x|3 d(x) + 302 + 3 |x| dF (x) 


aac i.e., E\2,\° is uniformly bounded for |u| < 1. In addition, if we 
denote the distribution function of Z, by G, then G, may be simply 
expressed in terms of P and it follows from the fact that 2)(y) > a 
and Z)’(y) + a’ as w + O that G —+G,. It is also easy to see that 


E is continuous except at zero. 


If we now define the stopping time N"(d) for d > 0 by 
n 
N"(d) = least m > 1 such that |} Z| > ds (u)yn 
1 
or +” if no such ” exists, 


then, by Theorem 4,2, for all d > 1, there is a positive constant @"(d) 
and a positive integer ni» both independent of yw, such that 
p(w" (d) > nj > at(ayn &@ for all n >, and for all y sufficiently 
small. 

Since a has been chosen so that 6,69) < 6, it follows from 


Lemma 6,2 that 6 fw) < 6 for all uw sufficiently small. Thus, 
k k 5 
P » Z.| < novk, k = Lyeseyn aaP I Z| <% 6 wk, l<k<ni; 


the latter is just P [N"(no/5) > n]. Now, 6 was chosen so that 


no/5 > 1, Thus, for alln>n, 





16 
az B(no/6) 
a) Pi ») Z| < novk, K = 1,2..,8) aman ae 
1 


for all yp sufficiently small where a” = a"(no/5). 

Next, we must consider the sequence {x '}. We recall that x,! 
= x 'M) has the continuous distribution function se Hence, EX, ! = 
u/[P (x) )-F (zy ')). Writing m(y) = EX,', we note that m(y) ~ 
u/(F(a)~P(a')] as wp + 0 and m(0) = 0. Also, VarxX,' = tu)’, a finite, 
positive number. Since X,' is bounded, the moment generating function, 


¢ (t), of X,' exists for all t R} and 


= tx = re ae. 
ce i he CCAD 


= GO Xp 8 


V _ t 
|t|Co so3 for p sufficiently small; the latter 


Hence, ¢ , (t) <e 
function is bounded on any finite interval containing zero. Therefore, 
for y sufficiently small, say |p| < Uy» the family {Hs  u | < Ug} 
satisfies properties (i')-(iv'). Further, as yp > 0, $e) + 6,(t) and, 
SO, a + Hy. 

As in Chapter 5, we let h = h(y) be the unique root of 2) 
= 0 and let t(p)2 = , (h)/$ (Hh). We define the stopping time W'(d) 


for d > 0 by 
" 
N'(d) = least nm > 1 such that |) x," > do (u) Yn 
1 
or +@ if no such m exists. 


Then, by Theorem 5.1, it follows that for each d > 1 and n > 0 such 
that d-n > 1, there exists a positive constant a'(d) and a positive 


integer n,, both independent of wy, such that 


(3) PIW'(d) > nJ > at (do (-A) I” o7lh| (d-n)t¥n | -B(d-n) 
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for all n > 7n, and all w sufficiently small. 
Now, by assumption (f), (a-n)o > (c-2n)o (0). Also, since 
3 Cu)? > 3 (0)? as wy > 0, it follows that for all yw sufficiently small, 


(c-2n)o (0) > (e-3n)o (u). Hence, 
k 
(4) P ||) x."| < (e-n)ovk, k = 1,...,"| > P [W'(c-3n) > n]. 
af i — 


Thus, combining (3) (with d = c-3n) and (4), we see that since by 


assumption (a), c-4n > 1, it follows that 


k 
ie \} Mae < (o-n)oVky k= Lyssa sn| 
Fg a 


(5) -|A|(c-4n)t¥n | -8 (e~4n) 


> a'lo (-A))” é 
for all m > my and all yw sufficiently small where qa! = qa'(c-3n). 


Let m, = max {7% , mo}. It follows from (1), (2), and (5) that 


py >a J etl-toe o,(-h)1 -|h| (o-4n) evn ,.-[8 (o-4n) +8(n0/6) } 
no 

for all yw sufficiently small, where a = a'a”" is a positive constant. 

Assumptions (b) and (d) imply that pag eer) > ntBta) Hie 

Recalling that by Lemma 5.2, -log $ (A) ~ m(u)*/20 (0)? as u + 0, we 

see that -log oh) is positive for sufficiently small values of wu. 


Thus, replacing the above sum by an integral and writing m for m(y), we 


obtain 


~2(1-[8(c) + €/2]) 


EN > m 
“log ¢ (-h) = |h| (e-4n) ty -({B(e) + €/2] 
are exp |-y —_———— - y ty 
9 m2 |m| 


n 
0 
It follows from the dominated convergence theorem and the fact that 


m=m(u) V uw/[F(a)-F(a')] that this lower bound, say J(y), is such that 
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2{1-[8(e) + €/23)/ y 
0 


exp|- 


e-4n 
Jig mee 7: See 








J(u) vy 


a 
0 20, (9) a (0) 


This last integral is finite [10, p. 337] since we have chosen e€ such 


that B(c) + €/2 < 1, Hence, if 


a y e-4n 
A= “| exp |- ——- 7 Vite + UN 
2 0 20 (0) o (0) 





for example, then for all y sufficiently small EW > 


alc pea Ma a I 


2, Upper Bound 
The above theorem shows that for the lower bound to hold, it 
suffices to assume only the existence of an absolute third moment 
rather than that of a moment generating function. However, the common 
distribution function is still assumed to be continuous, On the other 
hand, the same type of upper bound is valid if we again assume that a 
moment generating function exists, but no longer require that the 


common distribution function be continuous. We prove 


Theorem 6,2. Let (xX bet be a sequence of i. i. d. random variables 
defined by x, = x + yw, where x is such that EX, = Q, Varx, =o7, a 
finite, positive number, and Be*1 < @ for t in a neighborhood of zero. 


If for any positive ec, 
n 
N(ec) = least n > 1 such that ») x, | > eovn 
1 
or +m if no such n exists, 


then for each ¢ > 1 and any e€ > O, there exists a positive constant B, 


independent of y, such that for all yp sufficiently small 
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EN(c) < Blais? eines 


Proof. Suppose that the sequence (x) is defined on the probability 
space (2, F, P). Without loss of generality, we may assume that on 
this same space there is a sequence of i. i. d. random variables {y 3 
with a common W(0, 6%) distribution, where 6 > 0 is arbitrary; further, 
we may assume that the sequences (x } and Be) are independent, and, 
therefore, also, that {x} and {y 3 are independent. 

We fix ¢ > 1 and write W for N(e). Again, since EW = 


) P(N > n), we consider P(W > n) for n fixed. For any n > 0, we see 
0 





that 
k 
P(N > n) = Pi|) X.| s covk, kK = ljsseyn 
1 
k . 
Id X,| < covk, 1<kan; 1) Y.| < nov, l<jcn 
(6) P h Y.| < nov, lsj<n 


k 
Pp ) (X,+Y,) | < (ctn)ovk, kK = 1,...,7 
1 





P ii Y.| < novj, J = Lyeve yn 
1 


As noted in Chapter 3, it follows from Theorem 2 of Breiman that 


-B (no/S) as n> where qa, is a 


aiD) Y.| < novj, j = 1es.yn eae 1 
1 


positive constant. Thus, there exists an n, such that for n >> 


a 
(7) P )) Y. | < novj, eo ee, > pn Binal) 
1 
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Now, let Z - ZY) 2 x + Ye We note that {2} is a sequence 


of it. i. d. random variables with EZ, =U, VarZ, = g* + s°, and Ret4l = 








202 222 y 
exp 2 : | Ee’?! = exp 2 : + ue] ke Hence, for uw sufficiently 


Z 2 
tZ1 (v) 
small, say lu < Up, the moment generating functions Ee are uni- 
formly bounded on a finite interval containing zero on which Be! <r 


Further, the distribution function, say eae of Z, is the convolution of 
the distribution function of x, and that of Y,; thus, an is continuous 
and G —“+G, as u+0, Therefore, the family (G,, |u| < ug} is like 
those considered in Chapter 5. 


We define the stopping time N .(d) for any d > 0 by 
n 

N .(d) = least n > 1 such that |) Z| > dvg2+52/n 
1 


or +” if no such n exists. 


We write oa = pene and again denote the unique root of the equation 


$,' () « 0 by -h = -h(u). Also, we write t2 = t(y)? = o (A) /¢ (-A). 
Then, it follows from Theorem 5,1 that for each d > 1 there exists a 


positive integer n, and a positive constant a,(d), both independent of 


2 


u, such that 


(8) P{N,(d) > n} < a, (4) t¢ (-h)Y" ol2| (dtn)tvn | -8(d+n) 


for all nm > n, and all uw sufficiently small. Finally, we note also 


that 
k 

(9) P\ |} Z,| < (etnovk, k = 1,...5| < PIV, (etn) > n}. 
1 


So far, 6 and n have been arbitrary positive constants. Let 


€ > 0 be given. We choose n > O such that B(c+2n) > B(e) - €/4. Then 
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we choose 6 > O such that B(no/é) < €/4. These choices are possible by 
Proposition A.1l. 


Let n. = max {n,, n.}. Then, we see from (6), (7), (8), and 


0 2 


(9) that 


oj) cemmmaniommt: 


2? oo 
EN < ny S25 ocnl-log ¢(-a)] lal (et2n)t¥n -[8(e+2n)-8(no/65) ] 
ln 
0 


for all yw sufficiently small. We note that B(c+2n)-8(na/5) > 

B(c) - ¢/2. Again, by Lemma 5.2, -log $ (-h) ~ y2/2(02+62) as pw > 0 
and, so, is positive for sufficiently small y. Hence, using Lemma 3.1 
and proceeding as in Theorem 5,2, we may replace the series by an 


integral to obtain for all sufficiently small iu, 


yr2(1-(8(e) = &/21)2%2 


2a 
Boe mn 
EN < No + a, K(y) a, 


> -~log ¢ (-A) = |h| (e+2n)t 7 
u? ul 


where K(y) > 0 as yp > 0. Again, the integral term is asymptotic to 








91. 7 2a,{- y e+2n 7 _ 
y72(1-[8(e) - e/21)2 3) of “3 fly P@) = 27215, a. 
Bae 2(024+62)  va2462 

u +O. Thus, for example, if 

ta, {~ y e+2n 7 _ 

ne 2 exp |- + Vy ly [8(e) Meal. 

a) j 2(02+62) o2+52 

a finite positive constant, then EN < Balas for all y 


sufficiently small. II 


Finally, we are also able to weaken the requirement that the 
random variables have a moment generating function; however, the bound 


we obtain is not as sharp. 
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Theorem 6.3. Let 0 eae 


defined by x = x + yp where Ne is such that EX, = (), VarX, = 0%, a 


be a sequence of i. i. d. random variables 


finite, positive number, and E\x,|*° <@ for some 8 > 1. If for any 


@> 0d, 
n 
N(c) = least n > 1 such that |} X,| > co/n 
1 
or + if no such m exists, 


then for each e > 1 there exists a positive constant B, independent of 


u, such that for all yw sufficiently small 


where y(c) = B(ev2)/2. 
Proof. Suppose that the sequence {x} is defined on the probability 
space (2, °%, P). Without loss of generality, we may assume that on 
this same space, there is another sequence (x '} of i. i. d. random 
variables such that x has the same distribution as ne and such that 
the sequences {x} and {x} are independent. For uy # 0, we write 
ue = x! + yp and let W'(e) denote the stopping time N(ec) defined with 
respect to {x '}. 

Fixing ¢ > 1, we write W and NW’ for N(e) and N'(e) respective- 


ly. Since EW = ) P(W > n), we obtain bounds for the probabilities 
0 


P(N > n). First, we note 


tt 


P(N > n)* = P(N > n, N' > n) 


(10) 


JA 


k 
PI |) (X, - X,")| < 2G0VK Karelia ete 
1 
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Defining Y. = X. - X.', we see that FY. = 0, VarY. = 20%, and 
n n n n n 


Biel <, Thus, if we define the stopping time N)(d) for d > 0 by 
n 
Ny) (d) = least m > 1 such that |} Y.| > dov2/n 
1 
or + if no such m exists, 


then, applying Theorem 2 of Breiman [3], we obtain for d > 1 the fact 


that P{W, (d) >n}% ain ° (a) 


as n+ where qa’ is a constant which 
depends on d and the distribution of ye Noting that the right side of 
(10) equals P[W, (ev2) > nj}, we conclude that there exists a positive 


-B(e¥2)/2 for all 


integer ny» independent of wy, such that P(N > n) < an 
n> mn, where qa is a constant, independent of u. We write Y(e) = 
B(ev2)/2 and note that y(e) < B(e) < 1. 
Also, by Chebychev's inequality, P(N > n) < n-*EN?, Since 
e|x [°° < © for some 6 > 1, it follows from an inequality obtained by 
Woodroofe [16] that ZEN < dEN where d is a positive constant which is 
independent of u. Thus, P(N > n) < dy~?2n-2EN, 
Now, for each m > ny, we write 
zn eo 
EN<n +) P(N >n) + } P(N > n) 
no m+] 


ZN + ani ¥ fe) + du~2m7 EV, 


In particular, if we choose m = [2duy-2] where [x] is the greatest 
integer less than or equal to x, then it follows that there exists a 
positive constant B (e.g., B= 4{(ny + a(2dy7¥ 64) }) | independent of un, 


Bache hat ecoetal auteicvently small (nee ace smabumas {| 





APPENDIX 
THE FUNCTION 


In [3], Breiman first studies the stopping time fae = 
inf {t: |w(t)| > evt, t > 1} where {W(t), & > 0} is the standard Brown- 
ian motion process, He proves that as t+, P(r * > t | W(1) = 0] ~w 
-B(ce) 
at where -28(¢c) is the largest pole of 
+ 
900) = gre I 4 seg Be 
( (=a) 
Dy e)+D Cc 
for \E €, Re X} > 0. Here, D(z) is the parabolic cylinder function. 
Using certain standard identities (e.g., see [l, p. 687]), we see that 
-B(c) is, in fact, the largest zero of the confluent hypergeometric 
function M(), 4, e2/2) regarded as a function of A. We remark that the 
function M(a, b, 3) is given by the power series 


2 (a) a" 


M(a, fone 2) = } mn 
0 (6), nt 
where (a), = 1 and (a) = (a) (atl)... (atm-1), m > 1. This series 


converges as long as db is not a negative integer. 


Proposition A.1. The function 8(¢c) is a continuous, strictly decreas- 

ing function on (1, @) with 0 < 8(e) < 1, 8(1) = 1, and lim B(¢c) = 0. 
om aed 

Also, 8 is right continuous at c = l. 


Proof. That 8(1) = 1 and lim 8(¢c) = 0 are included in Theorem 1 of 
lomo) 


Breiman's paper. The relevant properties of M(A, i, e*/2) used below 
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are contained in {l, p. 504ff]. 

For a fixed ¢c, the zeros of M(A, $, e*/2) are all negative and, 
so, B(c) > 0. Also, M(O, $, c2/2) = 1 and M(-1, $, ¢7/2) = 1 - e% < 0 
for all c > 1, Hence, since M(A, $, c*/2) is a continuous function of 
A, it must have a zero in the interval (-1, 0); i.e., B(e) < 1 for 
e@>l. 

Let ec 


C, be such that 1 < ec, < ¢@,. We note that for fixed i, 


1? 1 2 


-l <A <0, MQA, 4, x) regarded as a function of x is strictly decreas- 
ing. Hence, for all \ € (-1, 0), MQ, 4, e,7/2) > M(A, $, e,*/2) and, 
SO, ~B(e,)), the largest zero of M(A, $, e,*/2), is less than -8(c,). 
Thus, B(c,) > B(e,) and 8 is strictly decreasing for ¢ € [1, ~). 
Finally, we show that 8 is continuous. The monotonicity of 8 
implies that it may have at worst only jump discontinuities, We fix 


@) 2 1 and consider B(c,") = lim, B(e,+e) < Bley). For fixed x, > 0, 
- er0* ~ 


0 


MA, £, xy) is strictly increasing for A} € (-1, 0). Thus, 
- 
M[-8(e, ee ar one) > MI-BCe,), , e,7/2) = Q and, so, there is an 


z, 2 ¢,2/2 such that M[-8(c,"), 4, 2,] = 0 since M(A,, #, 2) is contin- 


l 
uous and decreasing as a function of x. However, for alle > 0, 
M[-B(e,+e), 4, x] > M{-B(e,."), 4, 2,] = 0 and, consequently, x, < 


(e,te)2/2, Hence, 2, = ¢,2/2 and -B(c,') is a zero of M(A, +, ¢g2/2), 


l 
implying -B(c,") < ~B(e,), the largest zero of this function, There- 
fore, B(e,”) = B(cy) and 8 is right continuous for alle >l. A 


similar argument demonstrates that 8 is left continuous for ec > 1 and, 


thus, 8 is continuous on (1, &), il 


We make one additional remark about the function 8B. As noted 


above, for any X € (-1, 0), M(A, 4, x) is strictly decreasing as a 
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function of x. Hence, for ¢ < 1, M(A, 4, 07/2) > MQ, 4, 4) and the 
latter is greater than zero for all id € (-l, 0) since 8(1) = 1. Also, 
M(-1, $, e*/2) = l-c* > 0, Thus, we conclude that for alle <1, 

B(e) > l. 

Although the function 8 arose in conjunction with the study of 
the stopping time Pr.’ for the Brownian motion process, we showed in 
Chapter 4 that this same 8(c@) occurs in the study of the asymptotic 
behavior of P[N(c) > n) where N(e) is the analogous stopping time 
defined for certain sequences of i. i. d. random variables, Therefore, 
it is exactly this function 8 which plays such an important role 


throughout this paper. 
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